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ABSTRACT 

During the 1972-73 school year the educational 
program in Community School District 24, New York City, was 
supplemented by a quality incentive grant from State Uurban Education 
funds. These funds were used to establish two programs. The major 
objectives of the Corrective Reading program were: (1) to provide 
corrective reading diagnostic and prescriptive services for each 
participant so that he will increase his competence in reading; and 
(2) to increase individualization of instruction for program 
participants through the services of paraprofessionals as a means of 
increasing pupil growth in reading. The data presented in this report 
support the conclusion that the program was successful in achieving 
its objective. The major objective of the English As A Second 
Language (ESL) program was to increase the ability of non-native 
speaking pupils to understand and speak English. A corollary 
objective of the program was to move ESL students toward the 
acquisition of reading and writing skills in English as readiness is 
attained. Among the findings revealed by the evaluation of the 
program operation wer^ the following: (1) major changes in the 
planned program design were made at each school; these changes did 
result in more students being serviced by the program than originally 
planned, but the changes also resulted in a concomitant reduction in 
the average amount of instruction in English received by students in 
the program and (2) there was high mobility in the non-English 
speaking student population. (Author/JM) 



ERIC 



us DEPAKrWENt OF HEALTH 
EDUCATION A WElf A»E 
NATIONAL INSTITUTE OF 
LDUCAnON 

> » [ I I.'-, > .\ , I -.1 {1 » 

I ' ' t ■. > f I LI I , ,\ I 1 1 p ^4 i ■) k' I c 1 1 N 

- ' ' ' > i'M 'i,'. t ^^»,.-,| iN'. • . t , t r o» 



Function Nos. 



79-36452 
79-36453 



AN EVALUATION OF STATE URBAN EDUCATION PROGRAMS 
FOR DISADVANTAGED STUDENTS IN 
DISTRICT 24 NEW YORK CITY 



State Urban Education Grant 



An evaluation of a New York City school district 
education project funded by the Nev York State Urban 
Education Program enacted at the 1970 Leginiative 
Session of the New York State Legislature for the 
purpose of "meeting special educational needs 
associated with poverty" (Education Law 3602 # 
siabdivision II as amended) » performed under a con- 
tract with the Board of Education of the City of New 
York for the 1972-73 school year. 



Project Co-Directors 

Paul A. Cullinan 
Angela M. Jaggar 



CENTER FOR EDUCATIO^V.L RESEARCH AND FIELD SERVICES 
School of Education 
New York University 



July 1973 



ACKNOWLEDGEMENTS 



The directors of the project vieh to express 
appreciation to the following members of the professional 
staff of the evaluation teamt 

Professor Bernice E. Cullinan, New York University 

Professor Harvey Nadler, New York University 

and to the Research Assistants! 

Gloria Dwyer, Diana Leoj Michal Pelzigj 
Maggie Ramsay^ Carroll Seron and Jean Weiss 

We gratefully acknowledge the assistance of the 
District office administration and staff in all aspects 
of this evaluation • The cooperation of the corrective 
reading teachers^ teachers of English to speakers of 
other languages t program coordinators and the project director 
made this report possible. 

Finally, we would like to thank the liaison officersf 
teachers, principals, and pupils of the schools for their 
continued support and cooperation. 



ERIC 



TABLE OF CONTENTS 



LIST OF TABLES iv 

EXECUTIVE SUMMARY vi 

INTRODUCTION xvii i 

CORRECTIVE READING PROGRAM 1 

Program Objectives •••• 1 

Evaluation Objectives. 1 

Methods of Data Collection 2 

Description of Program in Operation 2 

Effects of Program on Children 26 

Summary and ConclUbX^ns 52 

Recommendations. • • • 57 

ENGLISH AS A SECOND LANGUAGE PROGRAM 61 

Program Objectives 61 

Evaluation Objectives 61 

Methods of Data Collection 61 

Description of Program in Operation 62 

Effects of Program on Children 76 

Summary and Conclusions v 86 

Recommendations c * 88 

APPENDICES 90 

Corrective Reading Program, A-E. . . . ^ 90 

English As A Second Language Program, A-E. 116 



ERIC 



LIST OF TABLES 



Paqe 

Corrective Reading Program 

Table 1. Location of State Urban Corrective Reading 

Centers and Number of Pupils Serviced 3 

2. Corrective Reading Teachers' Evaluation Of 
Inservice Training Program • . • 9 

3. Comparison of Teachers', Principals', And 
Coordinator's Overall Evaluation Of Inservice 
Training Program 11 

4. Mean Ratings For Program Organization* 

Physical Facilities And Materials 13 

5. Mean Ratings For Pupil Selection, Diagnosis 

And Evaluation Procedures • 16 

6. Mean Ratings For Student And Parent Attitudes 
Toward Program ^ 20 

7. Mean Ratings For Personnel Support 23 

8. Ntimber And Percentage Of Pupils Making Gains 
Below, The Same As, And Above Anticipated On 

The Metropolitan Achievement Test . , ^ ^ 29 

9. Tests of Significance For Actual And Above 
Anticipanted Gains On The Vocabulary Subtest Of 

The Metropolitan Achievement Test 32 

10. Tests Of Significance For Actual And Above 
Anticipated Gains On The Comprehension Subtest Of 

The Metropolitan Achievement Test . ^ t • 33 

11. Tests Of Significance For Actual And Above 
Anticipated Gains On The Total Reading Score 

Of The Metropolitan Achievement Test* 34 



iv 



List of Tables (Continued) 



Page 



Table 12. Ntimber And Percentage Of Pupils Making Gains 
Belov, The Same As,-, And Above The Anticipated 
Grade Level Score On The Stanford Diagnostic 
Reading Test 36 

13. Tests Of Significance For Actual And Above 
Anticipated Gains On The Grade Level Score Of 

The Stanford Diacrnostic Reading Test , 38 

14. Number And Percentage Of More Severely And Less 
Severely Retarded Elementary Pupils Making Gains 
Below, The Same As, And Above Anticipated 40 

15. Comparison Of Gains Of More Severely And Less 
Severely Retarded Elementary School Pupils 42 

16. Pre- To Post- Test Gains On Subtests Of The 
Stanford Diagnostic Reading Test.. 44 

17. Pre- To Post- Program Changes In State Urban 
Students' Reading Attitude 46 

18. Comparison Of State Urban Program With Tax 

Levy Program ^ 49 

English As A Second Language Program 
Table 1 . Schools And Number Of Teachers In The ESL Program. . 62 

2. Rank Order And Mean Rating For Observed 
Instructional Behaviors In ESL Classes 68 

3. Rank Order And Mean Ratings For Observed Student 
Behaviors In ESL Classes. « 73 

4. Overall Ratings Of Teacher Effectiveness 75 

5» Analysis Of Gains On The English Oral Language 

Ability Scale (OLAS) 79 

6. Comparison Of Number And Percentage At Each Oral 
Language Fluency Level At The Beginning And End 

Of The Program c . . 81 

7. Analysis Of Gains On The Linguistic Capacity 

O Index (LCI). 84 

ERLC 



V 



EXECUTIVE 'SITMMARY 



Durinq the 1972-1973 school year the educational proqrnm 
in Community School District 24, New York City, was supplemented 
by a quality incentive grant from State Urban Education funds. 
These funds vere used to establish a Corrective Reading Program 
and an English as a Second Language Program. The major objectives, 
findings and recommendations for the tvo programs are summarized 
below. 

CORRECTIVE READING PROGRAM 

Program Objectives . The States* Urban Education Correct ivo 
Reading Program had the followinq primary objectives: 

1, To provide corrective reading diagnostic and pre- 
scriptive services for each participant so that he will increase 
his competence in reading, 

2. To increase individualization of instruction for 
program participants through tbe services of paraprofessionals as 
a means of increasing pupil grorth in reading. 

Findings for Reading Achievement .. The data presented in 
this report support the conclusion that the program was successful 
in achieving its objective to increase participants* reading 
achievement levels. The following findings support that conclusion. 

1 • When actual post-test performance was compared to 
anticipated performance, more thaia 50 percent of the students at 
each grade level and of the total group made gains aboye expected 

vi 



in word knovledge, reading comprehension and total reading on 
the Metropolitan Achievement Test and the comprehension subtest 
of the Stanford Diagnostic Reading Test » In fact^ in total 
reading achievement! 69 percent achieved above expected, seven 
percent the same as expected and 24 percent below expected, 

2. Grade level comparisons showed that the gains made 
above those anticipated in vord knowledge, comprehension and total 
reading on the Metropolitan Achievement Test were statistically 
significant for all grade levels, except the second grade where 
students' achievement in comprehension was greater than expected 
but not significantly greater. Th«i same comparison for scores on 
the Stanford Diagnostic Reading Test indicated that students in 
all grades except the second and sixth made gains significantly 
above those expected in reading comprehension based on their 
previous rate of growth. The lower gains among second and sixth 
graders may be accounted for by the relatively small number of 
students in the evaluation samples. The second and sixth grade 
students in the evaluation samples did make average gains that 
were higher than expected but these gains were not significantly 
higher than expected. 

3. Comparisons of the gains of the more severely and 
less severely retarded readers revealed that more than 50 percent, 
and often 60 to 70 percent, of the students in each group made 
gains above expected in all areas of reading measured. A greater 
percentage, however, of the more severely retarded readers than 
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of the less severely retarded readers achieved above expected gains 
in word Xnowledg^^, compr^ension and total reading as measured by 
the Metropolitan Achievement Test and the Stanford Diagnostic 
Reading Test. 

4. Although both the more severely and the less severely 
retarded readers made reading achievement gains significantly above 
those anticipated for them, there was evidence that the more 
severely retarded rejaders made greater gains than the less 
severely retarded readers. These findings suggest that the 
program was more successful with students who were more severely 
retarded in reading at the beginning of the program^ Similar 
findings were reported in the 1971-1972 evaluation and suggest again 
that the amount of improvement in reacling is directly related to 
the amount of instruction provided. 

Findings for Specific Reading Skills . The data presented 
in this report support the conclusion that the program was 
successful in increasing participants* performance in specific 
reading skills. The following finding supports that conclusion. 

When pre-test and post^test scores on the appropriate 
level of the Stanford Diagnostic Reading Test were compared, gains 
in all skill areas were significant. Younger students in the 
program made gains that were generally more significant than gains 
made by older students in the program. 
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Findings for Reading Attitude . The t^ird obiectJve of 
the Corrective Reading Program was to improve program participants' 
attitude toward reading, Pre-program and post-program scores on 
the Reading Attitude Index were used to assess progress toward 
this objective* 

The data presented in this report support the conclusion 
that the program was not successful in improving program parti- 
cipants' attitude toward reading. The following finding supports 
that conclusion. 

When pre-program and post-program scores on the Reading 
Attitude Index were compared, attitude toward reading was no more 
positive at the end of the program than it was at the beginning 
for students at any grade level. Students in the sixth grade 
became significantly less positive in their attitude toward reading 
during the year. 

Findings for Impact of Paraprof essionals . The data 
presented in this report support the conclusion that the addition 
of paraprofessional services did not significantly increase pupils' 
growth in reading achievement and, therefore, the program objective 
was not achieved. Students in the State Urban Education Program 
did show improvement in their attitudes toward reading, however. 
The following findings support the conclusions stated above. 



1 . When pre-test and post-'test scorers of students in the 
State Urban Education Corrective Reading Program were compared 

to pre-test and post-test scores for students in the tax levy- 
corrective reading program # no significant differences were found 
in total reading achievement as measured by the Metropolitan 
Achievement Test. 

2. When pre-test and post-test scores of students in the 
State Urban Education Cc-.'^ective Reading Program were compared 

to pre-test and post-test scores for students in the tax levy 
corrective reading program^ significant differences were found in 
reading comprehension skills as measured by the Stanford Diagnostic 
Readincr Test which favored the tax levy students. 

3. Attitude toward reading scores of the State Urban 
Education Corrective Reading Program participants on the Reading 
Attitude Index were significantly more positive than those of 
students in the tax levy corrective reading program. It ia 
difficult to attribute the changes in attitude toward reading to 
the addition of paraprofessional services since the role of the 
paraprofessional is not clearly evident in teachers' reports of 
paraprof essionals • duties . 

Recommenda t ions . The evidence presented in this report 
points to the general success of the Corrective Reading Program 
in affecting aignificant student progress in basic reading skills 



and total reading achievement. Thus, the following irecorainendations 
are offered as guidelines for further improving and refining the 
program now in operation. 

1. There were nearly one-third of the program participants 
who were achieving less than their expected rate of growth. 

This may be due to weaknesses in diagnostic procedures and the 
prescriptive instruction used for these children. Every effort 
should be made to determine the causes for the low achievement of 
this group, as a means of improving the reading instruction for 
all children. 

2. Since the program has been successful in improving 
basic reading skills among a large proportion of the population, 
efforts should now be made to move these students toward increased 
reading comprehension and higher level critical reading skills. 
Programmatic efforts could include increased use of a variety of 
high interest materials and improved teaching skill for the v-^irop- 
ment of interpretive, inferential, analytical and evaluative 
reading skills. The intent of such efforts would be not only 

to increase students* reading proficiency but their enjoyment of 
reading as well. There was evidence that this important corollary 
objective was not achieved in the current program. 

3. Th.e district staff should seriously weigh the gains 
to be derived from inclusion of second graders in the Corrective 
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Reading Program. On the basis of the selection instrumenta and 
criteria used in the program, it is highly inappropriate to 
include second graders. It is recommended that the program be 
limited to students in grades 3 through 9, If early identification 
of reading or other learning disabilities becomes a goal for 
District 24 „ careful study will need to be made of the concomitant 
implications for screening, selection, program and evaluation 
procedures . 

4. There was again evidence that the amount of improvement 
in reading achievement was related to tlie amount of instruction 
received- Therefore, the staff shcnld continue to accurately 
assign the more severely retarded readers to the instructional 
groups that meet more frequently. 

5. There was evidence that the level of professional 
preparation among the reading teachers was higher than the pre- 
ceding year. This is & desirable trend and the district should 
make every effort to continue to recruit qualified specialists 
for the program. However, the niamber of students who are still 
not achieving above their previous rate of growth and the need 
to expand the achievement of those who are making gains above 
expected to include higher level reading skills do point to the 
need for continued inservice training that emphasizes the goals 
of this program. 
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6. If the objective to provide paraprof essional sprviros 
.as a means of increasinq student achievement in reading is to bo 
continued r chanqes must be made in the role presently assumed 

by paraprof essionals. The paraprof essionals' role should be 
defined as primarily instructional; they should receive adequate 
traininr f(.»r the role> and the reading teachers should be 
adequately prepared to effectively use the paraprof essionals in 
the instructional proqram. If paraprof essionals are not used 
in instructional roles> then this aspect of the program should 
be reassessed. 

7. Provision must be made for adequate time for reading 
teachers to confer with parents and classroom teachers who should 
play a siqnificant coopeirative role in the resolution of reading 
problems. 

8. The district staff should continue in the direction 
of providinq adequate diagnostic and prescriptive instruction 
in the developmental reading program, so that the separate 
Corrective Reading Program can be phased out. This will permit 
the reading specialists in each school to become reading resource 
teachers and teacher trainers who can offer classroom teachers 
specialized assistance in developing their reading programs. 

ENGLISH AS A SECOND LANGUAGE PROGRAM 

Program Objectives , The primary objective of the State 
Urban English as a Second Language (ESL) Proqram was to increase 
the ability of non-native speaking pupils to understand and speak 
English. 

xiii 



A corollary objective of thp proqrarn wa^q to movo 
ESL students toward the acquisition of reading and writing 
skills in English as readiness is attained. 

Findings for Program Operation ^ The evaluation of the 
program operation revealed the following findings. 

1. Major changes in the planned program design were 
made at each school. These changes did result in more students 
being serviced by the program than originally planned, but the 
changes also resulted in a concomitant roJjtCtion in the average 
amount of instruction in English received by students in the 
program. 

2. The high mobility or the non-English speaking 
student population brought come instability to the instructional 
program and further recaced the amount of instruction students 
received. A number of students were transferred to the main- 
stream program b^^Iore their language facility was adequate for 
academic success in a regular classroom program. 

Z.. A wide range of ESL teacher competence was observed. 
In q'anoral, ESL teachers were skilled in a narrow range of 
teaching behaviors related to second language learning. 

Findings for Students* Receptive and Productive 
Competence . The evaluation of program effectiveness resulted 
in the following findings. 
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1. For the total ESL sample, regardless of grade 
level, students in the program showed significant pre- to 
post-program gains in all receptive and productive English 
language skill areas. 

2. A consistent age related pattern of language 
learning emerged from the data. Children in grades kindergarten 
through grade three showed the greatest growth in English 
proficiency, students in grades four through six demonstrated 
somewhat less growth, while students in grades seven to nine 
demonstrated the least amount of growth in English proficiency. 

While the data did show that students in the ESL 
program made significant gains in their ability to understand 
and speak English, no conclusive statement can be made about 
the program's effectiveness since no comparison group was 
available. It is difficult to conclude, therefore, that the 
gains made by the students in the ESL program were greater 
than those that might have been expected from students in a 
regular program with no specialized instruction in English, 
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Recoimnendat ions . Based on the findings of this 
evaluation of the ESL Program, the following recommendations 
are made. 

1. An effort must be made to structure the ESL Program 
so that students will receive consistent and adequate amounts of 
instruction in the use of English commensurate with their level 
of language proficiency. 

2. A study should be made of the extent and nature of 
the population mobility in each school in order to design a 
program that would provide stable instruction for larger 
numbers of students. Provisions must be made to offer new 
arrivals needed instruction in English without transferring 
students to the mainstream before they aare proficient enough in 
English to succeed academically. 

3. There is a need to recruit teachers for the program 
who have been adequately trained in ESL techniques or to expand 
the inservice training in order to improve the present ESL 
teachers • e f f ect ivenes s . 

4. While oral fluency in English is essential as a valid 
objective f the ESL Program should be expanded to include the 
tool subjects of reading and writing in Endflish if students are 
to successfully achieve in the regular school curriculum. 
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S„ Because of the subjective nature of teacher ratinqs, 
it is fiuqqested that whenever possible more objective measures, 
sucVk as the Linguistic Capacity Index f also be used. Multiple 
measures provide more accurate information for pupil selection^ 
for diagnosis of children's language strengths and weaknesseSf 
and for assessment of pupil achievement in learning English as a 
second language, 

6. Analysis of pre- and post -program scores showed that 
the youngest children in the program (grades kindergarten to 3) 
made the greatest gains. Although the greater language learning 
facility generally found among younger children may account for 
this finding, other factors such as differences in instructional 
approach, program structure and teacher effectiveness may have 
been operating. These and other factors should be examined in 
order to determine how the effectiveness of the program might be 
increased in the upper grades. 
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INTRODUCTION 



During the 1972-73 sdliool yearf the regular 

educational prograuns in District 24 New York City were 

supplemented with educational services supported by a 

Quality Incentive Grant luider the New York State Urban 

Education Program. This report includes evaluations of 

programs funded tmder the following headings! 

!• Diagnosis and Treatment of Reading 

Disabilities Program (Corrective (79-36452) 
Reading) 



II. English as a Second Language (79-36453) 
Program 
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CORRECTIVE READING PROGRAM 

PROGRAM OBJECTIVES 

The Sitate Urban Education Corrective Reading Program 
had the following as primaxy objectives! 

1. To provide corrective reading diagnostic and 
prescriptive* servicts for each participant so that he will 
increase his competence in reading, 

2. To increase individualization of instruction for 
program participants through the services of paraprofessionals 
as a means of increasing pupil growth in reading* 

EVALUATION OBJECTIVES 

To assess program ef fectivenessy the following evaluation 
objectives were delineated! 

!• Given pre- and post -test scores^ program participants 
will manifest significant improvement in (a) total reading achieve- 
ment > (b) specific reading skills, and (c) attitude toward reading. 

2. Given pre- and post -program scores • children in the 
Corrective Reading Program will manifest significantly better 
improvement in reading achievement and attitude toward reading 
when compared to students in a parallel program which does not 
use paraprofessionals. 
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METHODS OF DATA COLLECTION 

In order to assess the effectiveness of the program in 
achieving the stated objectives, the following methods were used. 
Questionnaires eliciting the background preparation of the Corrective 
Reading Teachers, their assessinent of the inservice training 
provided, and their assessment of the ef fecrtiveness of the program 
(see Appendix A) were administered. In addition, the opinions 
of the principals, the program coordinator, and classroom teachers 
with students in the Corrective Reading Program were elicited 
through questionnaires (Appendices B,C, and D), 

Three measures were used to assess pupil growth in 
reading. Scores on the Metropolitan Achievement Test were used 
as the measure of pupils' level of reading addevement. Growth 
in specific reading skills was assessed by scores on the subtests 
of the Stanford Diagnostic Reading Test , and pupils* attitude 
toward reading was measured by the Index of Reading Attitude 
(Appendix £)• The three measures were administered on a pre and 
post test basis. 

DESCRIPTION OF PROGRAM IN OPERATION 

Program Implementation . During the 1972-1973 school year. 
District 24 established diagnostic and prescriptive reading 
centers to service remedial readers in 11 schools, seven elementary, 
one intermediate and three junior high schools. Table 1 shows the 
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schoolsi the number of teachers and the number of students in 
the Corrective Reading Program. 

TABLE 1 

LOCATION OF STATE URBAN CORRECTIVE READING CENTERS 
AND NUMBER OF PUPILS SERVICED 

Number of Number of 



School 


Teachers 


Students 


P.S, 


13 


1 


55 


P.S. 


14 


1 


55 


P.S. 


19 


2 


110 


P.S, 


68 


1 


55 


P.S. 


81 


1 


55 


P.S, 


143 


2 


110 


P.S. 


199 


1 


55 


I.S. 


61 


3 


165 


J.K. 


73 


2 


110 


J.H. 


93 


2 


110 


J.H. 


125 


2 


110 






18 


990 



Subtotals 

Elementary 9 495 

Intermediate 3 165 

Junior High 6 330 

18 990 
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As Table 1 shows, a total of 990 pupils received 
corrective reading instruction. Of these, 495 were elementary- 
school children, 165 were intermediate school children and 
330 were junior high school students. 

P rogram Organization . This was the second year of 
operation for the Corrective Reading Program, the basic structure 
of which was carefully planned and successfully tested during the 

1971- 72 school year. Based on the evaluation of the first year's 
program, some modifications were made in the organization of the 

1972- 73 program. These modifications brought about a needed 
reduction in the Corrective Reading Teachers' workload. 

This year, the design for the State Urban Education 
program called for each reading teacher to service five instruc- 
tional groups of approximately 11 students each, a total of 55 
pupils per teacher. From the target population at each elementary 
school, 33 students who were two or more years retarded in readincj 
and 22 students who were less than two years but not less than 
one year retarded in reading were selected for the program. 
The 33 more seriously retarded readers were divided into three 
groups, each of which met three times a week. Two of these groups 
met for one and a half hour sessions or a total of four and a 
half hours of instruction a week. The third group of more severely 
retarded readers met for one hour and 15-rainute sessions or a 
total of three hours and 45 minutes per week. The 22 students 
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with less severe reading problems were divided into two groups, 
each of which met two times a week for one and a half hoursj a 
total of three hours of instruction weekly. 

Each intermediate and junior high school reading teacher 
met each of the five instructional groups on a daily basis • 
All pupils in the program at this level received 45 minutes of 
instruction per day, five days per week, a total of three hours 
and 45 minutes per week. Efforts were made to have three of the 
groups consist of more severely retarded readersj and the other 
two groups to consist of less severely retarded readers. 
Organizing instructional groups into more and less seriously 
retarded readers, as the design specified,, was more difficult to 
do at the secondary schools than at the elementary schools because 
of scheduling difficulties. 

In the schools not eligible for Title I service* three 
45 -minute periods a week were set aside for teachers to provide 
additional individualized instruction to program participants 
in need of special attention in skill development or reading in 
the content areas. In addition, teachers had two 45-minute pre- 
paration periods a week for program related activities such as 
record keeping, lesson planning, preparation of materials, and 
conferences with parents, classroom teachers and paraprofessionals. 
In schools eligible under Title I (P.S. 58, P.S. 81, P»S. 143 and 
I.S. 61), teachers had all five 45-minute periods per week for 
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program preparation in accord with the contract with the? United 
Federation of Teachers i however, they could use these periods to 
provide additional instruc±ion to students who needed special 
attention. 

Program Staff . The prot^ram was coordinated by the 
district's reading specialist for reimburseable programs. His 
responsibilities included conducting an initial orientation and 
the biweekly inservice training sessions. Based on last year's 
evaluation, the elementary and secondary staffs met on alternate 
weeks so that the inservice training sessions could focus on the 
special needs and problems of the staff at each level. In 
addition, the program coordinator was responsible for the ongoing 
supervision of the program. 

1 • Corrective Reading Teachers 

The 18 Corrective Reading Teachers represented a wide 
range of teaching experience and background preparation for the 
task. Of the 17 who responded to the Corrective Reading Teacher 
Questionnaire (Appendix A), all reported they had obtained the 
Bachelor's degree, two since 1970, six between 1960 and 1969, and 
nine before 1960. Twelve of the Corrective Reading Teachers have 
received a Master's degree, five of whom had reading as their 
major field. Two others reported they had 30 credits beyond the 
Bachelor's degree including courses in the teaching of reading. 
Another indicated she was presently enrolled in a Master's degree 
program in reading. 
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When asked to indicate courses they had taken that were 
relevant to teaching corrective reading^ 12 teachers responded 
they had taken a course in Foundations of Reading Instruction, 
eight had taken courses in Diagnostic Reading Techniques, Corrective 
Reading Instruction, and Reading in the Content Areas, and two had 
a course in Individualized Reading Instruction. Some teachers 
had also had a course in learning disabilitiesf reading for the 
disadvantaged or children's literature. 

These findings do Indicate that the level of professional 
preparation among teachers in the State Urban Corrective Reading 
Program vad higher this year than it was last year. However, 
there are still some teachers in the program who lack adequate 
background preparation for the program. 

The 17 teachers who responded also reported a range of 
experience in teaching corrective reading. The group as a whole 
reported from one to eight years of experience in teaching 
corrective reading in the public school Seven had done private 
tutorial work in reading? five had taught in after-school tiutorial 
reading programs, and four had experience as parent -volunteer 
reading tutors. 

In general, then, the corrective reading staff in this 
year's State Urban Education Program appeared to have a higher 
level of professional preparation than last year's staff. Only 
six of the 18 teachers were new to the District 24 program this 
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year, indicating that a majority of the teachers were familiar 
with the basic aims and operation of the Corrective Reading Program. 
2 i Pa raprofessionals 

To provide furtJ.er individualization of instruction to 
program participants ^ one full time paraprof essional was assigned 
to each elementary school Corrective Reading Teacher. Each 
paraprofessional was to participate in daily and long range 
planninijf provide assistance with individual and small group 
instruction, assist with record keeping and preparation of materials, 
and escort students to and from their classes. In addition, 
the paraprofessionals attended biweekly inservice training sessions 
and received on-the-job training during the year. 

Evaluation of Inservice Training . The insei^irice training 
program for the District 24 Corrective Reading Teachers was an 
attempt to raise the level o:T teacher effectiveness and thereby 
increase the possibilities for the success of the program. Bi- 
weekly sessions conducted by the program coordinator focused on the 
program components of selection of students, diagnosis and 
remediation of reading problems. New materials were demonstrated 
and problems related to the program were discussed. The Corrective 
Reading Teachers at the elementary level and those at the junior 
high school level met with the prograun coordinator on alternate 
weeks so that the discussions could be more specifically directed 
toward concerns that were crucial to each group. 
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The Corrective Reading Teachers vere asked to evaluate 
the adequacy of the information presented in the inservice 
training program on the Corrective Reading Teacher Questionnaire 
(see Appendix A). Sixteen of the 18 teachers responded « The 
rating scale used wast Isunsatisfactory, 2aibarely satisfactoryt 
3=:average, 4=abave average^ and Savery satisfactory. Items that 
were not covered were assigned NC, Tlie tabulation of the ratings 
appears in Table 2, 

TABLE 2 

CORRECTIVE READING TEACHERS' EVALUATION 
OP INSERVICE TRAINING PROGRAM 

(N=16) Frequency for 







Each Rating 






Mean 
Rating 


Topic 


NC* 


1 


2 


3 


4 


5 


Organization, administration & 
supervision of the program 


0 


0 


1 


4 


6 


5 


3.9 


Program objectives & rationale 


0 


0 


0 


1 


7 


8 


4,4 


Criteria for selection of 
participants 


0 


1 


0 


6 


2 


7 


3.9 


Procedures fOr selection of 
participants 




1 


1 


4 


3 


6 


3.8 


Specific procedures for diagnosis 




0 


0 


3 


6 


6 


4.2 


Knowledge of reading skills 




0 


1 


7 


5 


2 


3.5 


Methods of corrective instruction 




1 


4 


7 


2 


1 


2.9 


Use of instructional materials 




2 


1 


3 


5 


4 


3.5 


Selection & evaluation of materials 


2 


1 


1 


4 


5 


3 


3.6 


Organizing class for instruction 


2 


1 


2 


3 


5 


3 


3.5 


Techniques for evaluating progress 


0 


1 


1 


6 


2 


6 


3.7 


Record keeping policies & procedures 


0 


0 


0 


7 


4 


5 


3.9 


Techniques for using parapro- 
fessionals (Ns9) 


1 


0 


0 


4 


3 


1 


3.6 


Techniques for parent involvement 


3 


1 


4 


6 


0 


2 


2.8 



♦Not covered 
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The frequencies and mean ratings shown in Table 2 indicate 
that the Corrective Reading Teachers found the information in 
the inservice training program related to program objectivest 
rationale^ organization and pupil selection to be veil above 
average. Furthermore » it should be noted that no topic presented 
was rated below 2,8 (close to avenge). In comparison with the 
ratings of similar components of the inservice training program 
during 1971 -72 # this yearns assessment by the Corrective Reading 
Teachers is generally more positive. The area which elicit€KJ 
markedly increased ratings was techniques for using parapro- 
fessionals (2.6 to 3,6), Corrective Reading I'eachers in the 
program demonstrated a positive level of satisfaction about the 
content of the inservice training program j although several 
xmsolicited comments on the questionnaires shoved some dis- 
agreement about the schedule of meetings. The complaint that 
meetings were too frequent when the time was needed in the class- 
room was made several times. The need for more demonstration 
teaching » more stress on learning disabilities and methods as 
well as examination of materials for the classroom were requested. 
One teacher wanted to suggest topics for the agenda so that dis- 
cussions of concrete techniques and problems were included. The 
State Urban Education Corrective Reading Teachers appeared to 
have high standards for the inservice instruction they wanted. 
The requests for specific suggestions to improve their teaching 
were widespread, 

O 
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The item ratings of the inservice training program were 
generally very positive and indicated the Corrective Reading 
Teachers believed they profited from it» 

The principalSf Corrective Reading Teachers and the program 
coordinator were asked to evaluate the amount and the quality of 
this year's inservice training program and to com^iare it with the 
previous year, A comparison of their responses can be seen in 
Table 3, 

TABLE 3 

COMPARISON OF TEACHERS', PRINCIPALS' AND COORDINATOR'S OVERALL 
EVALUATION OF INSERVICE TRAINING PROGRAM 

Corrective Program 
Item Rdg. Tchrs. Principals Coordinator 
(N=16) (NailO) (N=l) 

Was the amount of inservice 
training sufficient? 

NO 6 2 0 

YES 9 8 1 

NO RESPONSE 10 0 

On a 1 to 5 scale» give your 
overall rating for this year's 
inservice program 

MEAN RATING 3.5 3.8 4.0 

Did you (your teachers) par- 
ticipate in last year's 
inservice program? 



NO 6 10 

YES 10 9 1 



Compared to last year this 
year*s training wass 



INFERIOR 2 0 0 

ABOUT SAME 4 3 0 

SUPERIOR 4 6 1 
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The responses seen in Table 3 show that the program 
coordinator and a majority of Corrective Reading Teachers and 
the principals foimd the amount of inservice training to be 
sufficient. These groups found the quality of the inservice 
training to be well above average. Only two teachers » among 
those participating the previous year> found the inservice training 
to be inferior, whereas four teachers and three principals thought 
it was about the same and four teachers and six principals thought 
it was superior to the prior year. 

The overall ratings of the inservice training program were 
generally positive and showed a sizeable increase over the ratings 
of the previous year. Comments which were written on the question- 
naires suggested a need for more demonstration teaching by fellow 
teachers and the coordinator, more demonstrations of diagnostic 
techniques and specific skill remediation techniques, and more 
opportunities for new teachers to observe experienced teachers. 
It should be noted that six of the 16 Corrective Reading Teachers 
who responded were ner to the program this year. The new teachers 
indicated they would benefit from additional guidance in the 
implementation of the program. 

Evaluation of Program Organizationj Facilities and Materials . 
The organization of the Corrective Reading Program and the facilities 
and materials used in its operation were evaluated by 17 Corrective 
Reading Teachers, ten principals, the program coordinator and 63 
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classroom teachers who had students in the program. The same 1 
to 5 rating scale, used throughout all questionnaires » was used 
to indicate the level of satisfaction for each topic the rating 
group evaluated. When a group was not asKed to rate a specific 
item, a slash mark is inserted in the tables* Th-^ mean ratings 
for program organization, facilities and materials appear in 
Table 4. 

TABLE 4 

MEAN RATINGS FOR PROGRAM ORGANIZATION, 
HIYSICAL FACILITIES AND MATERIALS 

Reading Program C la ssroom 
Item Teachers Principals Coordinator Teachers 
(N:=17) (N=10) (N=l) LN=63) 

Program Organization 

Organization (scheduling^ 

number of classes, etc.) 4.2 3.9 5.0 3.5 

Amount of time allocated 

for reading instruction 4.1 4.0 5.0 3.6 

Nximber of pupils' in 

each group 3.9 3.7 4c 0 

OVERALL RATING 4,2 4.2 5.0 3.6 

Physical Facilities and Materials 
Size of roomis) for 

corrective rdg^ instr. 2.8 2.8 3.0 

Physical facilities 

in room 2.8 2.8 3.0 

Types of instruct, 
materials provided 

for program 4.0 4.4 5.0 

Quantity of materials 

provided 4,0 4,2 5.0 

Availability of 
materials at start of 

program 2.9 4.0 4.0 

OVERALL RATING 3.4 4.0 4.0 
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The mean ratings shown in Table 4 show that the general 
level of satisfaction with the Corrective Reading Program 
organization is well above average. The item receiving the lowest 
rating from the Corrective Reading Teachers* nvunber of pupils 
in each group, averaged 3.9 (above average). The 3.9 rating is 
well above the 2.0 rating given this item in the 1971-72 evaluation. 
The programmatic change from servicing 78 pupils per teacher to 
servicing 55 pupils per teacher undoubtedly accounts for the 
increased ratings. Several Corrective Reading Teatihers commented 
that this year's ratio produced a desirable size for the groups. 

The classroom teachers gmsre the lowest ratings in the 
assessment of program organization, although they were well above 
average. Some classroom teachers remarked that the scheduling 
of students disrupted their classrooms and that missing one and 
a half hours of regular classroom work was difficult for students 
who were remedial readers. The general tone of comments volunteered 
by each rating group was positive, however, and the ratings con- 
firm the favorable attitude toward the Corrective Reading Program 
organization. 

The ratings of physical facilities and materials range 
from 2.8 to 5.0. The Corrective Reading Teachers themselves do 
not regard their facilities and materials as favorably as others 
related to the program regard them. The comparison of ciirrent 
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rather than the one previously usckJ in the program f was an 
attempt to arrive at a more realistic assessment of students 
needing remediation. The single achievement score used in pre- 
vious years tended to inflate actual performance or show the 
frustration level at vhich a student could work rather than his 
instructional level. 

The Corrective Reading TeacherSf principals^ program 
coordinator and classroom teachers were asked to rate the pro- 
cedures used for pupil selectiont diagnosis and evaluation* The 
summary of their ratings appear in Table 5. The slash marks show 
that a particular group 'was not asked to rate that item. 

TABLE 5 

MEAN RATINGS FOR PUPIL SELECTION, DIAGNOSIS 
AND EVALUATION PROCEDURES 

Reading Program Classroom 

Teachers Principals Coordin. Teachers 
Item (N=17) (N«1G) (Ngp (Na63) 

Pupil Selection 

Criteria used to select 

pupils 2.8 3.3 4.0 2.7 
Procedures used to 

select pupils 3.4 3.9 4.0 3.0 

Assignment to groups 
on basis of severity 

of reading retardation 3.3 3.5 4.0 

Number of students 
serviced compared to 
number ^o need 

corrective reading 2.2 2.2 4.0 2.7 

OVERALL RATING 3.2 3.6 4.0 2.9 
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Reading Program Classroom 
Teachers Pr inci pa Is Coord in . Teacher e 
Item (N^17) (NglO) (N=sl) (N=63) 

Diaqnosla and Evaliaation 

Use of Informal Reading 

Inventory 3.9 — 4.0 

Use of Metropolitan 

Reading Test 3.1 3.1 3.0 

Use of Stanford 
Diagnostic Reading 

Test 3.9 4.0 4,0 

Materials provided for 

diagnosis and evaluation 3.5 4.0 4.0 

Record Keeping system 3.5 4.1 5.0 

OVERALL RATING 3.6 3.8 4.0 

The ratings for pupil selection procedures shown in 
Table 5 vary from 2.2 to 4.0. The Corrective Reading Teachers 
and the classroom teachers are least satisfied vith aspects of 
selection. Comments by Corrective Reading Teachers indicate that 
they would like the screening procedures to be even more thorough. 
Vision and hearing tests were suggested as needed additions. 

The selection criterion related to poverty was criticized 
by some Corrective Reading Teachers. They point out that even 
children of average financial circumstances need reading assistance. 
The requirement to test all children at the beginning of the year 
to see if they qualify in educational need as well as in financial 
need is a burdensome task. The plan of assigning students to 
groups according to level of retardation appears to be satisfactory 
to the associated staff. 
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One issue that obviously plagues Corrective Reading Teachers, 
principals and classroom teachers is the numbers of children who 
receive specialized instruction in reading in relation to the 
number vho need it. The 2,2 and 2,7 ratings show that few are 
satisfied with the availability of specialized instruction. 
It is Clear that more students need the additional help than 
receive it but attempts to resolve this problem will probably 
create other problems • Some of the funded programs have attempted 
to service all children vho need the help without increasing 
the size of the professional staff. ThuSf more children are 
serviced but all then receive less individualized help. The 
result associated with the distribution of limited services is 
that all children achieve less. The only reasonable way to extend 
corrective reading services is to increase the number of corrective 
reading teachers. Maintaining a high qaality and thorough corrective 
reading program must be weighed against broader distribution of 
services. 

The overall ratings of the pupil selection procedures 
ranged ^rcan Aightly below average (2.9) by the classroom teachers 
to above average (4.0) by the program coordinator > The issues 
involved in the disparate ratings perhaps cannot be resolved but 
at least should be understood by staff associated with the program • 
The same disparity existed in the 1971-72 program evaluation and 
perhaps suggests open discussion of the issues involved. 
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The evaluation of the diagnoels and evalx:^tion procedures 
resulted in above average ratings for every aspect assessed. The 
combined use of the Metropolitan Achievement Teat and the Stanford 
Diagnostic Reading Test has increased the overall level of 
satisfaction vith diagnosis and evaluation procedures from the 
1971-72 evaluation report. The continued recognition of the need 
to use the Informal Reading Inventory is supported by the 3,9 
and 4,0 mean ratings of Corrective Reading Teachers and the program 
coordinator. 

The Corrective Reading Teachers indicate that they want 
more materials for diagnosis and evaluation vhich is in accord 
with their assessment of naterials in the preceding section. 
The record keeping system was rated lowest by Corrective Reading 
Teachers (3.5) and highest by the program coordinator (5.0). 
The revisions made in the procedures for keeping the daily logs 
apparently have increased the level of satisfaction since the 
1971-72 evaluation. The 2.8, 3.0 and 4.0 ratings of the record 
keeping system in effect during 1971-72 has changed to 3.5, 4.1 
and 5.0 for the current record keeping system. One teacher 
commented that further improvement in record keeping is needed 
and suggested xiniformity and reduction of repetition. All 
suggestions were constructive » and reflected a desire to perfect 
the program. 
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The overall ratings of pupil diagnosis and evaluation are 
well above average. The revisions made in the present Corrective 
Reading Program have noticeably increas€Ki the level of satisfaction 
of the staff associated with the program. 

Evaluation of Student and Parent Attitudes Toward the 
Program. The objective to improve students' attitude toward 
the Corrective Reading Program was assessed directly from student 
data, however, the Corrective Reading Teachers, principals, program 
coordinator and the classroom teachers also were asked to judge 
students* attitude and progress as well as parents* attitude 
toward the program. The summary of their ratings appears in 
Table 6. A slash mark indicates that the group was not asked to 
respond to that item. 

TABLE 6 

MEAN RATINGS FOR STUDENT AND PARENT 
ATTITUDES TOWARD PROGRAM 

Reading Program Classroom 
Teachers Principals Coord. Teachers 
Item (N=17) (N=10) (N=l) (N=63) 

Students 

Students* attitudes toward 

corrective reading classes 4.2 3.9 4.0 3.7 
Observable improvement 

in pupil performance 4.0 3.9 4.0 3.2 
Parents 

Extent of parent involve- 
ment in the program 2.4 2.3 4.0 

Parents* attitude toward 

program 3.4 3.6 4.0 3.7 
Time for teachers to 

confer with parents 2.9 3.3 4.0 
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The mean ratings in Table 6 show a positive level of 
satisfaction from the Corrective Reading Teachers, principals, pro- 
gram coordinator and classroom teadiiers about students* and 
parents' attitude tov^rd^ the program. The ratings range near 
the 4.0 level indicating that the associated staff believes that 
the program is viewed above average by students and their parents. 
Voluntary comments made by several classroom teachers verify the 
positive nature of students* attitude. Comments such as, ••My 
students like their Co8?rective Reading Teacher very much and are 
anxious to go to her room," and ''The students in the program 
have shown a great increase in their desire to read,'* are 
indicative of the teachers' assessment of student attitude. 

The staff assessment of the observable improvement in 
pupil performance is nearly as favortible as their assessment of 
attitudes toward the program. The Corrective Reading Teachers' 
and the classroom teachers' ratings were lower than the other 
raters. Many comments by the classroom teachers indicated that 
their students had made very good progress in reading this year 
although one questioned attributing the improvement entirely to 
the Corrective Reading Program. 

The items rated lowest in the staff evaluation of parents' 
attitude and involvement dealt with the extent of parental 
involvCTient in the program. Both Corrective Reading Teachers and 
principals believe that parents' involvement is no more than 
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barely satisfactory. Both groups believe that parents* attitude 
toward the program is somewhat above average and that time for 
parent conferences in about average but it appears they are not 
satisfied with the extent to which parents actually do become 
involved in the program. 

The staff ♦s ratings of students* attitude is higher than 
their ratings of parents* attitude toward the Corrective Reading 
Program. The principals were least positive about the extent of 
parent involvement. Suggestions about orientation meetings for 
parents were made by several people. 

Evaluation of Personnel Support . The Corrective Reading 
Teachers^ principalSf program coordinator and classroom teachers 
evaluated the level of cooperation^ communication and interaction 
among school personnel in relation to the Corrective Reading 
Program. The State Urban Education Corrective Reading Program 
included the use of paraprofessional services at the elementary 
school level, therefore^ an evaluation of the qxiality of those 
services is incorporated here. 

The summary of the ratings made of the personnel support 
by the associated staff appears in Table 7. Slash marks show that 
the item was not rttted by that group. 
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TABLE 7 

MEAN RATINGS FOR PERSONNEL SUPPORT 



Reading Program Classroom 
Teachers Principals Coord. Teachers 
(N=17) (N-10) (Nail) (Nc:63) 



Item 

Cooperation of school 
personnel generally 3.9 

Communication between 
reading teacher and 
classroom teacher 3.6 

Adoption of corrective 
reading techniques by 
classroom teachers 3.2 

Time for corrective 
reading teachers to 
confer vith classroom 
teachers 2.7 

Classroom teachers* 

attitude toward 

program 3 . 5 

Paraprof essionals ' 
preparation and sxill 3.5 

(N«9) 

Quality of services 
provided by parapro- 
fessionals 4.1 

(N=9) 

Teachers* ability to 
use paraprofessionals 
effectively — 

Heading teachers^ pre- 
paration and skills for 
program 

Quality of instruction 
provided by the Corrective 
Reading Teacher 

Ongoing supervision by 
coord inator 3 . 9 



4.1 4.0 

3.7 4.0 3.4 

3.5 5.0 3.1 

2.9 4.0 2.5 

3.6 4.0 

4.2 4.0 

4.0 4.0 

4.0 4.0 

4.0 4.0 

3.9 
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The ratings shown in Table 7 indicate a generally high 
level of satisfaction among the staff related to the Corrective 
Reading Program. The Corrective Reading Teachers^ the principals > 
and the program coordinator believe that the cooperation from 
school personnel is well above average, A slight variation occurs 
in the ratings of ooramunication between the Corrective Reading 
Teachers and the classroom teachers where the ratings drop from 
around 4,0 to 3.4 and 3.6. An explanation for this decrease is 
clearly evident in the ratings of another item — time for Corrective 
Reading Teachers to confer with classroom teachers. The ratings 
of 2.7 » 2.9 and 2.5 assigned to this item by Corrective Reading 
Teachers^ principals and classroom teachers^ respectively, show 
that very few people are satisfiibd with this aspect of the program. 
Clearly, more staff conference time is desired. 

The ratings of the quality of paraprofessionals * services, 
the interaction between the Corrective Reading Teachers and para- 
professionals, and the level of preparation of paraprofessionals 
are very positive. Obviously, all groups view the contribution 
of the paraprofessionals to be a valid and worthy aspect of the 
program, 

A description of the responsibilities assumed by the 
paraprofessionals was requested of the Corrective Reading Teachers. 
The tally of the responsibilities showed that many things para- 
professionals do are not involved with instruction of children, 
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organizing mat:erialS| distributing and duplicating materials » 
correcting papers # escorting children and record keeping appear to 
consume a sizeable portion of the paraprofessional's day. Less 
than half of the duties listed vere directly instructional. 
The roles fulfilled by the paraprofessionals do not seem to 
adequately reflect the goal stated for using their services • nor 
do they reflect the role description in the program proposal which 
indicates that paraprofessionals would play a significant role in 
instruction. The proposal stated that paraprofessionals would 
assist in the prescriptive aspects of the program by having them 
work directly with individuals or small groups under the super- 
vision of the Corrective Reading Teachers. The additional roles 
described in the program plan appear to have become the primary 
roles fulfilled by most paraprofessionals. 

The ratings of the qtiality of instruction provided by 
the Corrective Reading Teachers and the ongoing supervision 
provided by the program coordinator were rated well above average. 
The level of satisfaction toward the central staff of the Corrective 
Reading Program appears to be high* 

Summary Evaluation of the Corrective Reading Procrram . The 
Corrective Reading Teachers (CRT) ^principals ^ the program co- 
ordinator and the classroom teachers were asked to compare the 
1972-73 program with the 1971-72 program. The majority of the 
staff involved the preceding year (11 CRT^s, ten principals, one - 
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coordinator, 33 classroom teachers) believed the current program 
is superior. When asked if they would be interested in partici- 
pating next year in a similar program, all 17 Corrective Rrjading 
Teachers, all principals^; and 60 of 63 classroom teachers said 
yes. It is evident that the District 24 staff is committed to 
the Corrective Reading Program they have designed and implemented. 
Support for continued refinement and development is clearly 
evident in their ratings of their satisfaction with the program. 

EFFECTS OF PROGRAM ON CHILDREN 

This section includes a discussion of the effects of 
the program on pupil growth in reading and is organized into four 
sections: growth in reading achievement, gro^^h in specific 
reading skills, improvement in reading attitude, and the impact 
of paraprofessional services. 

Growth in Reading Achievement . The first objective of 
the Corrective Reading Program was to improve participants* 
level of reading achievement beyond that which would be expected 
from the regular classroom program. 

To assess the extent to which this objective was achieved, 
children's scores on the M et r opol it a n Achievement Test were 
analyzed using their historical rate of growth as a control against 
which to compare the effects of the Corrective Reading Program, 
In this procedure, a pupil becomes his own control in that h4a 
historical rate of growth, which is calculated from his previous 
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performance records i© used to predict his expected level of 
performance if he had received no special instruction. The 
procedure for determining his rate of growth up to the onset of 
the special program is to subtract 1,0 from his pre-program 
achievement score and divide the remainder by the number of months 
the child has been in school » including the number of years he 
was retained » For example, if a fifth grade student scores 4.0 
in September* then based on his 40 months of previous schooling, 
his historical growth rate would be 3.0 divided by 40 or .075 
per month, or .75 per school year. By using the historical rate 
of growth, the child's achievement level at the end of fifth 
grade can be predicted, i.e., he should be reading at 4.75 
according to her previous performance* If, in fact, his anticipated 
level of performance is exceeded by his actual performance, then 
it can be claimed with some assurance that the gain beyond that 
anticipated was due to the effects of the special instructional 
program. This procedure was used to detennine whethor the 
Corrective Reading Program in District 24 had a significant effect 
on participants' reading achievement levels. 

Scores from the April, 1972 administration of the Metropolitan 
Achievement Test were obtained from school records as the pre - 
program measure and wer^a used as the basis for anticipating 
students* post -test performance the followinr April, 1973, when 
the test was again administered on a distrx.x-^wide b-^^^is. Complete 
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pre- and post-test data for the Metropolitan Achievement Test were 
available for 713 students or approximately 72 percent of all 
participants in the State Urban Education Corrective Reading Program. 
The size of the evaluation sample is sufficiently large to permit 
generalizations about the effectiveness of the program. 

A second measure of reading achievement was provided by 
the comprehension subtest of the Stanford Diagnostic Reading Test. 
The pre- and post -test grade level scores for achievement in 
comprehension also were analyzed using the historical rate of 
gz-owth method • Most students' pre-program scores were available 
in school records from the May, 1972 administration of the test. 
New students in the program were administered the Stanford Diagnostic 
Reading Test in October as a pre-test measure. Adjustments were 
made accordingly in calculating the students' post-test performances 
anticipated for May, 1973 when the test was again administered on a 
district-wide basis. Complete pre- and post -test data on this 
measure were available for 771 students or approximately 78 percent 
of the program population. 

1 . Total Group and Grade Level Results 

Using the historical rate of growth method, anticipated 
post-test scores for the Metropolitan Reading Tes t were calculated 
for students in the Corrective Reading Program. The number and 
percentage of students at each grade level and in the total group 
who obtained actual post-test scores below, the same as, or above 
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anticipated in vord )cnovledge, reading comprehension and total 
reading were cornered. The results are presented in Table 8. 

TABLE 8 

NUMBER AND PERCENTAGE OF PUPILS MAKING GAINS BELOW, 
THE SAME AS, AND ABOVE ANTICIPATED ON THE 
METROPOLITAN ACHIEVEMENT TEST 



WORD KNOWLEDGE COMPREHENSION TOTAL READING 



Grade N 








BgIov 


Sane 


ADOVe 


Belov 


Same 


Above 


2 


5 


1 


0 


4 


0 


0 


5 


0 


0 


5 






(20) 


(0) 


(80) 


( 0) 


(0) 


(100) 


( 0) 


( 0) 


(100) 


3 


134 


30 


9 


95 


44 


6 


84 


39 


8 


87 






(22) 


(7) 


(71) 


(34) 


(4) 


( 62) 


(29( 


( 6) 


(65) 


4 


137 


40 


9 


88 


49 


7 


81 


42 


11 


84 






(29) 


(7) 


(64) 


(36) 


(5) 


( 59) 


(31) 


( 8) 


(61) 


5 


104 


30 


1 


73 


24 


4 


76 


14 


6 


84 






(29) 


(1) 


(70) 


(23) 


(4) 


( 73) 


(13) 


{ 6) 


(81) 


6 


15 


2 


0 


13 




1 


11 


2 


0 


13 






(13) 


(0) 


(87) 


(20) 


(7) 


( 73) 


(13) 


( 0) 


(87) 


7 


90 


19 


2 


69 


28 


1 


61 


19 


10 


61 






(21) 


(2) 


(77) 


(31) 


(1) 


( 68) 


(21) 


(11) 


(68) 


8 


164 


44 


6 


114 


55 


3 


106 


42 


6 


116 






(27) 


(4) 


(69) 


(33) 


(2) 


( 65) 


(25) 


( 4) 


(71) 


9 


64 


17 


1 


46 


20 


2 


42 


14 


9 


41 






(26) 


(2) 


(72) 


(31) 


(3) 


( 66) 


(22) 


(14) 


(64) 


Total 


713 


183 


28 


502 


223 


24 


466 


172 


50 


491 


Percent 




(26) 


(4) 


(70) 


(31) 


(3) 


(66) 


(24) 


( 7) 


(69) 



Table 8 includeB results for a small group of second graders for 
Whom data vere available. Although the program proposal called for 
children only in grades 3 through 9 to be selected for the program » 
one groiip of second graders was included on a trial basis in one 
school in the hope that children identified as exhibiting reading 
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difficulties this early could be helped before their difficulties 
became serious. The second grade aanple is too small to allow 
generalizations about the effectiveness of the program at this 
level » but the data are included since their performance figures 
in the total group results and since the results may reveal 
trends for children at this grade level. 

As the data in Table 8 showy more than 50 percent of the 
children at each grade level and in the total group made gains 
above anticipated for them in vord knowledge and reading compre- 
hension^ two of the subtests on the Metropolitan Achievement Test , 
With the exception of the second and fifth graders t more children 
at each grade level achieved actual post-test scores higher than 
their anticipated scores in word knowledge than in reading compre-- 
hension. These results suggest that the instructional program 
was somewhat more effective at increasing students' reading word 
knowledge than at developing their skills in reading comprehension. 
In total reading achievements which is based on a composite score 
from the word knowledge and reading comprehension subtests* Table 
8 shows that more than 60 percent of the children at each grade 
level and in the total group made gains above those expected 
based on their previous rate of growth in reading. 

In summary f the data in Table 8 indicate that a substantial 
majority of the children in the State Urban Education Corrective 
Reading Program made gains above those expected from their previous 
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rate of grovthy including 70 percent in vord knovledge, 66 percent 
in reading comprehensiont and 69 percent in total reading 
achievement. 

Tables 9, 10, and 11 present the pre-test# anticipated 
post-test and actual post- test means, and the results of the 
tests of significance for act\:^l and above anticipated gains on 
the vord knowledge and comprehension subtests, and the total 
reading score of the Metropolitan Achievement Test « 

As Table 9 ^ovs, students at all grade levels, except the 
second and fourth grades, achieved more than one year in vord 
knowledge • Students in grades 3, 5, 6, 7, 8, and 9 had achievement 
levels comparable to or better than that normally expected of 
average readers in those grades* The second and fourth graders 
made actual gains of approximately eight months in vord knowledge. 
The data in Table 9 show further that all of the gains in word 
knowledge were significantly above those anticipated for the 
children at each grade level based on their previous rate of 
growths 

Table 10 shows that the actual gains in reading compre- 
hension ranged from nearly seven months for the fourth graders 
to one year and three months for the seventh graders* The 
second graders, and the fifth through the ninth graders achieved 
in reading comprehension at rates normally expected of non-remedial 
readers. As the t-ratios for the gains above anticipated indicate. 
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achievement in reading comprehension among children in grades 3 

through 9 vas significantly above that anticipated. Only th* 

gain above anticipated t-ratio for second graders was not significant. 

However, the second graders in the evaluation sample did achieve 

an average of more than one year above anticipated in reauing 

comprehension, suggestijng that the sample was too small to allow 

the results to reach an acceptable level of significance. 

Table 11 shows further the success of the program in 
helping children to achieve in reading at rates above those 
expected in a regular classroom program. It can be seen that pupils 
in the program achieved actual gains in total reading ranging 
from approximately seven months in the fourth grade to a year and 
four months in the sixth grade. Again, the second and fifth 
through ninth graders averaged a year or more gain in total reading 
achievement, while the third graders averaged nine months and the 
fourth graders averaged seven months gain. As the t-ratios for 
above anticipated gadns indicate, the achievement of children at 
all grade levels in total reading was significantly above that 
anticipated for them based on their previous rate of growth. 

Data in Tables 9, 10 and 11 suggest that the Corrective 
Reading Program was somewhat more effective in raising the reading 
achievement levels for fifth through ninth grade students than for 
third and fourth grade students. The findings do support the 
conclusion, however, that the Corrective Reading Program achieved 
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its first objective to improve participants' level of reading 
achievement beyond that vhich would be expected from the regular 
classroom program. This conclusion is supported further by the 
results of analyses of pre- and post- program grade level scores 
on the comprehension subtest of the Stanford Diagnostic Reading 
Test . Table 12 shows the number and percentage of corrective 
reading students vho achieved post-test scores belowf the same ar, 
and above expected in comprehension on the Stanford Diagnostic 
Reading Test, 

TABLE 12 

NUMBER AND PERCENTAGE OF PUPILS MAKING GAINS BELOW, 
THE SAME AS, AND ABOWE THE ANTICIPATED GRADE LEVEL SCORE 
ON THE STANFORD DIAGNOSTIC READING TEST 



Stanford Grade Score 

Grade N Below Same Above 

2 5 10 4 

(20) (0) (80) 

3 150 34 10 106 

(23) (6) (71) 

4 142 41 9 92 

(29) (6) (65) 

5 110 25 12 73 

(23) (11) (66) 

6 23 9 0 14 

(39) (0) (61) 

7 98 29 6 63 

(30_) (6) (64) 

8 166 56 3 107 

(34) (2) (64) 

9 76 32 0 44 

(42) (0) (58) 

Total 771 228 40 503 

Percent (30) (5) (65) 
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Table 12 s}:.ovs that more than 50 percent of the children at 
each grade level obtained actual post-test scores that were higher 
than their anticipated post-test scores. In the total corrective 
reading sample^ 65 percent achieved above expected » five percent 
achieved the same as expected » and 30 percent achieved below 
expected in reading comprehension. These findings are comparable 
to those based on the comprehension subsection of the Metropolitan 
Achienrement Test vhere 66 percent achieved above anticipated, 
three percent achieved the same as anticipated and 31 percent 
achieved belov anticipated in reading comprehension (see Table 8). 

Table 13 presents the means and the results of tests of 
significance for actual and above anticipated gains on the Stanford 
Diagnostic Reading Test grade level score for program participants* 
achievement in reading comprehension. It can be seen that children 
in the evaluation samples at each grade levels except the second 
and sixth grades » made gains significantly above those expected 
for them based on their previous performance. Since the second 
and sixth grade samples were substantially smaller than the samples 
at other grade levels it would be inappropriate to make any 
definitive statement about the program's effectiveness at these 
two grade levels. It i^ould be noted that the children in the 
evaluation samples at these two grade levels also averaged gains 
in reading comprehension that were above their anticipated 
achievement levels, but not significantly above anticipated. 
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In summary, the data in Table 13 further supports the 
conclusion that participants in the Corrective Reading Program* 
on the average » improved their reading achievement levels 
significantly* 

2. Level of Retardation Group RegujLts 

The Corrective Reading Program in District 24 was 
structured so that elementary school students who were two or 
more years retarded in reading received three periods of instruc- 
tion a week. Those irtio were between one and two years retarded 
in reading were given two periods of instruction a week. The two 
groups were compared to determine which group showed the greater 
gai> ^ in reading achievements 

Table 14 presents the number and percentage of more 
severely and less severely retarded readers in the program who 
obtained actual post-test scores above, the same as, and below 
anticipated on the word knowledge and reading comprehension 
subtests, and the total reading score of the Metropolitan 
Achievement T est , and the grade level comprehension score on the 
Stanford Diagnostic Reading Test* 



ERIC 



t 

o 
I 



3 



CO 



(0 H << 

CO 0) S 

« H 

ill 

MHO 

In 

CO CO S 

M H 
O p CO 

< u » 




0) 



m 

00 



GO 



00 



CM 



in 
in 



o 



00 

in 



m 



00 



in 



in 



CM 



H 0) 
0) 'O 

Ih u 
0) o m 
^ > -P 

o Q) 
SCO « 



OH 

in 



1^ 
in 



CO 



in 

CO 



o 



to 



00 



in 
in 



o 



OH 



cn 
in 



fH \D 
^ CI 



O 



in 



in 



in 



(0 (U fO 

o b o 



-41- 



As Table 14 shows ^ more than 50 percent # and often 60 
to 70 percent of the children in the more severely and the less 
severely retarded reading groups made gains above expected in 
the area^ measured. The data do indicate^ however ;v that a greater 
percentage of the more severely retarded readers than the less 
severely retarded readers achieved above expected in word know- 
ledge ^ reading comprehension, and total reading when measured 
by the Metropolitan Reading Test and in reading comprehension 
when measured by the Stanford Diagnostic Reading Test .. The 
findings in Table 14 suggest that the program was more effective 
with the more seriously retarded readers than with the less 
seriously retarded readers. This is confirmed by the data in 
Table 15. 

Table 15 presents the sample sizes, means and thci results 
of tests of significance for the t-wo groups* actual and above 
anticipated gains on the Metropolitan Achievement Test and tha 
Stanford Diagnostic Reading Test . Although both groups achieved 
significantly above their expected levels in all areas^ the 
more severely retarded readers averaged higher gains above anti- 
cipated than the less severely retarded readers. As the larger 
t-ratios for the more severely retarded group indicate* their 
gains in reading achievement were more significant than those 
of the less severely retarded group. 
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The data in Tables 14 and 15 support the conclusion that 
the program was more effective vith the participants who were 
more severely retarded in reading at the beginning of the 
program, than those wlio were less severely r^arded. A similar finding 
was reported in last year's evaluation and it suggests again 
that the amount of improvement in reading achievement is directly 
related to the amount of instruction provided* 

Growth in Specific Reading Skills , The second objective 
of the District 24 Corrective Reading Program was to provide 
individualized instruction so that participants would increase 
their performa^nce in specific reading skills* The measure used 
to evaluate this objective was the Stanford Diagnostic Reading 
Test . Level I of this test was administered to participants in 
grades 2 through 4 and to scmie students in the higher grades whose 
previous reading achievement levels indicated this was the 
appropriate test* The Level II test was administered to children 
in grades 5 through 9* Pre-program scores on this test were 
made available to thG Corrective Reading Teachers to use in 
diagnosing pupil weaknesses and planning insttruction. The pre - 
and post -test meanr and gain scores are shown in Table 16, for 
specified skill areas* 
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TABLE 16 

PRE- TO POST-TEST GAINS ON SUBTESTS OF THE 
STANFORD DIAGNOSTIC READING TEST 



Pre -Test Post -Test t- 

Mean SD Mean SD Gain Ratio* 

Level I Stanford Test (N=:395) 



1. 


Reading Comprehension 


22,37 


9.43 


31.34 


7.67 


8.97 


26.34 


2. 


Vocabulary- 


15.06 


5.39 


20.55 


7.25 


5.49 


17.77 


3. 


Auditory Discrimin- 
ation 


26.87 


10.99 


35.56 


8.86 


8.68 


16.77 


4. 


Syllabication 


10.10 


3.55 


13.38 


4.09 


3.28 


15.48 


5. 


Beginning and 
Ending Sounds 


22.22 


6.47 


29.03 


5.10 


6.81 


25.38 


6. 


Blending 


18.54 


8.77 


26.59 


7.24 


8.05 


25.80 


7. 


Sound Discrimin- 
ation 


14.97 


6.81 


20.50 


7.70 


5.53 


18.84 






Level 


II Stanford Test (N*234) 




1. 


(a) Literal 
Comprehension 

(b) Inferential 
Comprehension 

(c) Total 
C<Mnprehension 


16.14 
13.66 
29.89 


4.27 
4.85 
8.66 


18.91 
16.71 
35.42 


4.35 
6.07 
8.69 


2.77 
3.05 
5.53 


13.56 
9.42 
14.45 


2. 


Vocabulary 


21.95 


5.28 


24.98 


5.38 


3.03 


12.74 


3. 


Syllabication 


14.57 


4.06 


16.12 


3.78 


1.55 


8.01 


4. 


Sound Discrimin- 
ation 


18.86 


6.23 


21.40 


6.08 


2.54 


10.48 


5. 


Blending 


21.18 


8.47 


25.56 


7.64 


4.38 


15.63 


6. 


Rate 


17.87 


8.52 


19.48 


8.63 


1.61 


3.06 



♦All t-ratios significant at .005 
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The t-ratios in Table 16 show that the pre- to post-program 
gains in each skill area were significant at the .005 level. 
The skill areas in which the most significant gains were made on 
Level I of the Stanford Diagnostic Reading Test are reading cojn« 
prehension^ beginning and ending sounds and blending. The skill 
areas in nfhich the most significant gains vere made on Level II 
of the Stanford Diagnostic Reading Test are blending » total 
comp£*ehension» literal comprehension and vocabulary. The least 
significant gains vere made in rate of reading on the Level II 
test and sound discrimination on the Level I test. The younger 
children in the program made gains that vere generally more 
significant than those made by the older groups. 

The data presents in Table 16 support the conclusion 
that the second objective of the District 24 Corrective Reading 
Program to increase participants* performance in specific reading 
skills was achieved. Although no comparisons of gains in specific 
skills vere made vith groups not receiving the specialized 
instruction^ controlled comparisons vere made for the preceding 
objective related to total reading achievement:. The inference 
can be made that the gains reported here in specific skills are 
reflective of the total reading achievement gains and that control 
group ccHiiparisons vould parallel the findings presented in the 
preceding section on reading achievement. 
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Improvement in Reading Attitude > The third objective of 
the District 24 Corrective Reading Program vas to improve prograun 
participants* attitude toward reading* Progress toirnrd this goal 
was measured by a pre* and post-program administration of the 
Reading Attitude Index (see Appendix £)• The scale on this 
instrument is constructed so that a lover score reflects a mor^? 
positive attitude toward reading than a higher score. Therefore, 
an improvement in reading attitude would be indicated by a de- 
crease in students* post -test scores. The pre- and post -test means, 
difference scores and the t-ratios are presented in Table 17. 

TABLE 17 

PRE- TO POST-PROGRAM CHANGES IN STATE URBAN STUDENTS' 

READING ATTITUDE* 



Pre -Index Post -Index t- 



Grade 


N 


Mean 


SD 


Mean 


SD 


Diff . 


Ratio 


P 


2 


5 


38.80 


8.54 


42.60 


9.45 


+3.80 


1.21 


NS 


3 


142 


42.04 


9.07 


40.92 


8.31 


-1.12 


1.42 


NS 


4 


113 


40.37 


8.66 


39.62 


9.24 


-0.75 


0.84 


NS 


5 


105 


41.48 


7.74 


40.13 


7.47 


-1.35 


1.63 


NS 


6 


23 


38.64 


7.86 


42.09 


6.91 


+3.45 


1.93 


.05 


7 


76 


41.14 


7.89 


41.01 


7.14 


-0.13 


0.16 


NS 


8 


112 


42.68 


7.85 


42.47 


9.12 


-0.21 


0.26 


NS 


9 


59 


44.83 


9.09 


45.69 


9.74 


+0. 86 


0.73 


NS 


Total 


















Group 


634 


41.77 


8.46 


41.34 


8.60 


- .43 


1.23 





*A decrease in the Reading Attitude Index score represents an 
improvement in reading attitude. 

NSsNot statistically significant at ,05 
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The t-ratios presented in Table 17 show that there were 
no significant changes in program participants* attitude toward 
reading except at the sixth grade. The direction of the change, 
it should be noted, is toward a more negative attitude toward 
reading among sixth graders* 

The data presented here should be viewed in relation to 
the data presented earlier in Tables 10, 11 and 13« The data 
preseutod there show that sixth graders made the least significant 
gains in total reading and reading comprehension on the Metropolitan 
Achievement Test and that sixth graders made no significant gains 
above those anticipated for them on the Stanford Diagnostic Reading 
Test . It is evident that the Corrective Reading Program was 
least effective at the sixth grade for producing change in reading 
achievement and significantly less effective at the sixth grade 
for producing improvement in attitude toward reading. 

The data presented in Table 17 support the conclusion 
that the goal of improving program participants* attitude toward 
reading was not achieved. These data indicate that sixth 
graders' attitude toward reading became significantly more negative. 

Inferences can be drawn from these results which suggest 
that the Corrective Reading Program in District 24 successfully 
teaches students how to read but it does little to hlep them 
enjoy reading. The significant gains reported for growth in 
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total reading achievement and specific skills do not result in 
a parallel improvement in students* attitude toward reading. 
The long term effects of such a corrective reading program should 
be considered in evaluating its effectiveness. Furi:hermore» 
the causes for not affecting students* positive attitude toward 
reading while increasing their ability to read should be investi- 
gated. Perhaps the reasons lie in the em^^asis on the specific 
skills taught and in the content of the uaterials ue^^^. While 
repotrts of materials used in the program included some interesting 
literature for childrent the amount was minimal in relation to 
other materials used. 

Impact of Paraprof essionals . The final objective of the 
District 24 Corrective Reading Program was to increase individuali- 
zation of instruction for program participants through the services 
of paraprof essionals as a means of increasing pupil growth in 
reading. In order to determine the impact of para professional 
ser>rices» the evaluation plan called for a comparison between 
students in the reimburseable Corrective Reading Program and 
students in a parallel tax levy program that did not use the 
services of paraprof essionals. A change wat:; made in the tax levy 
program, however, and a full time paraprofessional was assigned 
to each tax levy reading teacher in March of the school year. 
Since the t»x levy program included paraprofessional services 
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for only one to one and a half months before the post -test was 
administered in April* coMparod to the seven to seven and a half 
months in the state Urban Education Program* the decision was 
made to proceed with the planned comparison. 

The comparisons between the State Urban Education Corrective 
Reading Progrzun with seven and a half months of paraprofessional 
service and the tax levy corrective reading program with one and 
a half months of paraprofessional service were made on the total 
reading score of the Metropolitan Achievement Test and the grade 
level score on the Stanford Diagnostic Reading Test as well as on 
attitude toward reading. The results of the analysis of covariance 
are presented in Table 18. 

TABLE 18 

COMPARISON OF STATE URBAN PROGRAM 
WITH TAX LEVY PROGRAM 



Gyoup 



N 



Pre- Post- Adj. 
Mean Mean Post 



df 



F- 
Ratio 



Total Reading 
(Metropolitan) 

State Urban 
Tax Levy 

Grade Level Score 
(Stanford) 

State Urban 
Tax Levy 

Reading Attitude 

State Urban 
Tax Levy 



390 
283 



417 
274 



238 



2.61 
3.93 



2.28 
2.57 



41.31 
39.66 



3.54 3.66 
3.77 3.77 



2.97 3.07 
3.32 3.17 



40.40 40.15 
41.71 42.11 



1/670 



3.73 



1/688 4.02 



1/610 9.08 



NS 



.05 



.01 
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The F-ratios shown in Table 18 reveal that^ when pre-test 
group differences were controlled » there were no significant 
differences between the po8t«-test scores of the State Urban 
Education students and the tax levy students in total reading 
achievement as measured by the Metropolitan Achievement Test , 
There were differences » however » on the post-test scores of the 
Stanford Diagnostic Reading Test in favor of the tax levy students* 
The results indicate that the addition of para professional 
services did not significantly increase pupils* growth in reading 
achievement. 

There was some indication^ as the data in Table 18 show^ 
that students in the State Urban Education Program with more 
paraprofessional services show significantly more improvement 
in their attitudes toward reading than students in the tax levy 
program. It is difficult to conclude, however, that this change 
in attitude is directly attributable to the services provided 
by paraprof essionals. However, it is possible that the additional 
contact provided by the paraprofessionals had a favorable effect 
on students' attitude toward the program and, therefore, their 
attitude toward reading generally* 

In summary, the data support the conclusion that the 
addition of para professional services does not significantly 
increase pupils* growth in reading achievement. The tenuous 
nature of this conclusion must be recognized, however, since 
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there was evidence that the paraprofessionals were not primarily 
involved in instructional roles. Therefore, it would be unlikely 
that their pres'jnce would have a direct effect on pupil achievement 
as it was proposed in the program objective. If paraprof essional 
services are proposed as a means of increasing individualization 
of instruction in order to directly affect pupil growth in reading, 
the para prof essional role needs to be clearly defined as instruc- 
tional in nature. When paraprofessionals do assume roles directly 
related to instruction, then it would be appropriate to assess 
the impact of their services on pupil achievement. 
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SUMMARY AND CONCLUSIONS 

The suininary and conclusions ire arranged in an order 
corresponding to the presentation of the report. 

Grovth in Reading Achievement s The first objective of 
the Corrective Reading Program was to improve participants* level 
of reading achievement beyond that which would be expected from 
the regular classroom program. Pre- and post-program scores on 
the Metropolitan Achievement Test and the grade level scores on 
the Stanford Diagnostic Reading Test were used to determine if 
this objective was achieved. Based on each child's previous 
rate of growth, anticipated post -test scores vere determined as a 
measure of how well the child would have achieved if he had not 
received special reading instruction. At the end of the program, 
the child's actual post-test performance was compared to his 
anticipated performance to see if the actual gains made were 
larger than those anticipated* 

The data presented in this report support the conclusion 
that the program was successful in achieving its objective. 
The following findings support that conclusion. 

1. When actual post-test performance was compared to 
anticipated performance, more than 50 percent of the students at 
each grade level and the total group made gains above expected in 
word knowledge, reading comprehension and total reading on the 
Metropolitan Achievement Test and the comprehension subtest of the 
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Stanford Diagnostic Reading Test » In fact» in total reading 
achievement t 69 percent achieved above expected » seven percent 
the same as expected and 24 percent below expected. 

2. Grade lervel comparisons shoved that the gains made 
above those anticipated in word knowledge, comprehension and 
total reading on the Metropolitan Achievement Test were statisti- 
cally significant for all grade levels^ except the second grade 
vhere students* achievement in comprehension was greater than 
expected but not significantly greater. The same comparisons 
for scores on the Stanford Diagnostic Reading Test indicated 
that studen1:s in all grade levels » except those in the second 

and sixth grades p made gains significantly above those expected 
in reading comprehension based on their previous rate of growth. 
The lower gains among second and sixth graders may be accounted 
for by the relatively small number of students in the evaluation 
samples. The second and sixth grade students in the evaluation 
sample did make average gains that were higher than expected but 
these gains were not significantly higher than expected. 

3, Comparisons of the gains of the more severely and less 
severely retarded readers revealed that more than 50 percent # 

and often 60 to 70 percent, of the students in each group made 
gains above expected in all areas of reading measured. A greater 
percentage* however, of the more severely retarded readers achieved 
above expected gains in word knowledge, compreherision and total 
reading as measured by the Metropolitan Achievement Test and 
the Stanford Diagnostic Reading Test . 
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4. Although both the more severely and the less severely 
retarded readers made reading achievement gains significantly 
above those anticipated for them^ there was evidence the more 
serverely retarded readers made greater gains than the less 
severely retarded readers. These findings suggest that the program 
was more successful with students who were more severely retarded 
in reading at the beginning of the program. Similar findings 
were reported in the;^ 1971-72 evaluation and suggest again that 
the amoi at of improvement in reading is directly related to the 
amouiJt of instruction provided. 

Growth in Specific Reading Skills . The second objective 
of the District 24 Corrective Reading Program was to provide 
individualized instruction so that participants would increase 
their performance in specific reading skills. Pre- test and post- 
test scores on the appropriate level of the Stanford Diagnostic 
Reading Test were used to determine if this objective was achieved. 

The data presented in this report support the conclusion 
that the program was successful in increasing participants* 
performance in specific reading skills. The following finding 
supports that conclusion. 

^ . When pre-test and post -test scores on the appropriate 
level of the Stanford Diagnostic Reading Test were compared » 
gains in all skill areas were significant. Younger students in 
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the program made gains that were generally more significant than 
gains made by older students in the program. 

Improvement in Reading Attitude , The third objective of 
the Corrective Reading Program was to improve program participants* 
attitude toward reading. Pre-program and post-program scores on 
the Reading Attitude Index were used to assess progress toward 
this objective. 

The data presented in this report support the conclusion 
that the program was not successful in improving program partici- 
pants' attitude toward reading. The following finding supports 
that cone lus ion • 

When pre-program and post-program scores on the Reading 
Attitude Index were compared, attitude toward reading was no 
more positive at the end of the program than it was at the beginning 
for students at any grade level. Students in the sixth grade 
became significantly less positive in their attitude toward 
reading during the year* 

Impact of Paraprofessionals , The final objective of the 
Corrective Reading Program was to increase individualization of 
instruction for program participants through the services of 
paraprofessionals as a means of increasing pupil growth in reading. 
Comparisons were made between the performance of students in the 
State Urban Education Corrective Reading Program and that of 
students in the tax levy corrective reading program. 
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The data presented in this report support the conclusion 
that the addition of paraprofessional services did not siqnifi- 
cantly increase pupils* growth in reading achievement and, there- 
fore, the program objective was not achieved. Students in the 
State Urban Education Progreim did show improvement in their 
attitude toward reading, however • The following findings support 
the conclusions stated above. 

1 . When pre-test and post -test scores of students in the 
State Urban Education Corrective Reading Program were compared 

to pre-test and post -test scores for students in the tax levy 
corrective reading program, no significant differences were 
found in total reading achievement as measured by the Metropolitan 
Achievement Test. 

2. When pre-test and post -test scores of students in the 
State Urban Education Corrective Reading Program were compared to 
pre-test and post-test scores for students in the tax levy 
corrective reading program, significant differences were found in 
reading comprehension as measured by the Stanford Diagnostic 
Reading Test which favored the tax levy students. 

3. Attitude toward reading scores of the State Urban 
Education Corrective Reading Program participants on the Reading 
Attitude Index were significantly more positive than those of 
students in the tax levy corrective reading program. It is 
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difficult to attribute the changes in attitude toward reading to 
the addition of paraprofessional services since the role of the 
paraprofessional is not clearly evident in teachers* reports of 
paraprofessional^ duties. 

RECOMMENDATIONS 

The evidence presented in this report points to the 
general success of the Corrective Reading Program in affecting 
significant student progress in basic reading skills and total 
reading achievement. Thus» the following reconunendations are 
offered as guidelines for further improving and refining the 
program now in operation. 

1. There were nearly one-third of the program participants 
who were achie^^d ab less than their expected rate of growth. This 
may be due to weaknesses in diagnostic procedures and the pre- 
scriptive instruction used for these children. Every effort 
should be made to determine the causes for the low achievement of 
this group as a means of improving the reading instruction for all 
children. 

2. Since the program has been successful in improving 
basic reading skills among a large proportion of the population > 
efforts should now be made to move these students toward increased 
reading comprehension and higher level critical reading skills. 
Programmatic efforts could include increased use of a variety of 
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high interest materials and improved teaching skill for the 
development of interpretive, inferential, analytical and 
evaluative reading skills. The intent of such efforts would be 
not only to increase students' reading proficiency but their 
enjoyment of reading as well. There was evidence that this 
important corollary objective was not achieved in the current, 
program* 

3. The district staff should seriously weigh the gains to 
be derived from inclusion of second graders in the Corrective 
Reading Program* On the basis of the selection instruments and 
criteria used in this program, it is highly inappropriate to 
include second graders. It is recommended that the program be 
limited to students in grades 3 through 9. If early identification 
of reading or other learning disabilities becomes a goal for 
District 24, careful study will need to be made of the concomitant 
implications for screening, selection, program and evaluation 
procedures . 

4. There was again evidence that the amount of improve- 
ment in reading achievement was r*lat€td to the amount of 
instruction received. Therefore, the staff should continue to 
accurately assign the more severely retarded readers to the 
instructional groups that meet more frequently. 

5. There was evidence that the level of professional 
preparation among the reading teachers was higher than the preceding 

O 
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year. This is a desirable trend and the district should make 
every effort to continue to recruit qualified specialists for 
the program. However » the number of students who are still 
not achieving above their previous rate of growth and the need 
to expand the achievement of those who are making gains above 
expected to include higher level reading skills do point to the 
need for continued inservice training that emphasizes the goals 
of this program. 

6, If the objective to provide paraprof essional services 
as a means of increasing student achievement in reading is to be 
continued > changes must be made in the role presently assumed 

by paraprof essionals . The paraprof essionals* role should be 
defined as primarily instructional; they should receive adequate 
training for the role, and the reading teachers should be adequately 
prepared to effectively use the paraprof essionals in the instruc- 
tional program. If paraprof essionals are not used in instructional 
roles, then this aspect of the program should be reassessed. 

7, Provision must be made for adeguate time for reading 
teachers to confer with parents and classroom teachers who should 
play a significant cooperative role in the resolution of reading 
problems . 

8, The district staff should continue in the direction 
of providing adequate diagnostic and prescriptive instruction in 
the developmental reading program so that the separate Corrective 
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Readinq Program can be phased out. This will permit the readinq 
specialists in each school to become reading resource teachers 
and teacher trainers who can offer classroom teachers specialized 
assistance in developing their reading programs. 
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ENGLISH AS A SECOND LANGUAGE 

PROGRAM OBJECTIVES 

The primary objective of the State Urban English as a 
Second Language (ESL) Program was to increase the ability of non- 
native speaking pupils to understand and speak English, 

A corollary objective of the program was to move ESL 
students toward the acquisition of reading aruJ writing skills in 
English as readiness is attained. 

EVALUATION OBJECTIVES 

In order to assess program ef f ectivenessj the following 
evaluation objective was usedi 

Given ratings of students • oral fluency in English on a 
pre-and post -program basis* pupils will manifest significant gains 
in their ability to use English, 

METHODS OF DATA COLLECTION 

Two measures were used to assess pupil growth in English 
as a second language. The '•A to F" Scale fo£ Rating Oral 
Lancraaae Ability of Pupils (see Appendix A) provided a measure of 
pupils* productive facility in English and is based on teacher 
ratings of children's oral skills in several language areas. 
The Linguistic Capacity Index, developed at the Southwest Edu- 
cational Development Laboratory^ was used as a measure of the 
pupils' receptive competence in Englisho Both tests were adminis- 
tered to students on a pre- and post-program basis. 
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Observations of the instructional program were made by 
the evaluation team using the ESL Observation Checklist (see 
Appendix B), and interviews were held with the program coordinator. 

DESCRIPTION OF THE PROGRAM IN OPERATION 

The English as a Second Language (ESL) Program was designed 
to service children in the target population in seven schools in 
District 24, Table 1 lists the schools and the nvimber of teachers 
in the State Urban ESL Program. 

TABLE 1 

SCHOOLS AND NUMBER OF TEACHERS 
IN THE ESL PROGRAM 

School Level No. of Teachers 

P.S. 19 Elementary 2 

P.S. 89 Elementary 3 

P.S. 143 Elementary 1 

P.S. 1 99 Elementary 1 

I.S. 61 Intermediate 2 

J.H. 73 Junior High 1 

J.H. 125 Junior High 1 



Total 11 

Program Design . Based on recommendations from the 
previous yearns evaluation^ an effort was made to design a care- 
fully planned program that was structured to provide students with 
consistent and intensive daily instruction over the entire 
treatment period. The proposed design called for 48 pupils to 
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be serviced by each of the elementary ESL teachers and 50 to be 
serviced by each of the teachers in the intermediate and junior 
high schocas. Thus, a total of 536 children were to be serviced 
by the program, 336 elementary and 200 secondary students. 

At each elementary school, each teacher was to divide the 
48 students into three groups* Two groups of 16 pupils each were 
to meet five times a week in one and a half hour sessions for a 
total of seven and a half hours of instruction each week* These 
32 pupils were to be drawn from :=*.mong students in the target 
population who were rated lowest (categories ''F," and •*D") 

in English proficiency based on the Scale for Rating Oral Language 
Ability of Students > The third group of 16 pupils was to meet 
four times a week for one hour and 15-minute sessions, a total 
of five hours of instruction weekly. This group was to include 
students in categories ••F," ••D," and who could not be serviced 
in the first two groups. Remaining places could be used to service 
students who were rated "C** in English oral fluency. 

At the intermediate and junior high schools, the design 
called for each teacher to divide the 50 pupils into five groups 
of ten stud3nts each. Each group would meet for 45 minutes per 
(Jay, five days- a week, a total of three hours and 45 minutes of 
instruction weekly. Three of the five groups were to be comprised 
of students most in need of instruction in English, those rated 
"F," "E," then on the oral language scale. The remaining two 
groups were to be selected primarily from the TJ** then category. 
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In schools not ellaible for Title I services 9 there were 
three 45Hninute periods set aside for providing additional 
individualized instruction during the week to small groups of 
five pupils who vere most in t. id of instruction^ those at the 
••F" fluency level. Teachers in these schools had two preparation 
periods a week for program related activities such as lesson 
planning^ screeningy placement and orientation of new pupils t record 
keeping 9 administering tests 9 and conferences with teachers 9 
parents 9 guidance counselors and supervisors. In the schools 
eligible for Title I services (P.S. 19, P.S. 1439 and I,S, 61), 
the design called for five preparation periods per week in 
accordance vVch the contract with the United Federation of 
Teacdiersi however, teachers could utilize these periods to pro- 
vide additional instruction to small groups of children in the 
"F* language category. 

The program was coordinated by the District English as a 
Second Language specialist who was responsible for conducting 
monthly inservice training sessions and for providing ongoing 
program supervision. 

Program Implementation . Examination of class rosters, 
observations in the schools, and conferences with the staff 
revealed that the ESL Program was not implemented according to 
the original design described above. Scheduling difficulties, 
the number of students considered actually in need of instmaction 
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versus the number planned for, the fluctuation in the target 
population, and administrative preferences vere factors which 
brought about substantial changes in the structure of the program 
at each school* 

In general, the changes made at the elementary schools 
meant that each teache.^ had more instructional groups, of varying 
sizes, meeting diffensnt amotmts of time during the week than 
originally planyied. Most of the elementary teachers taught five 
groups of children instead of three but tvo teachers had six 
groups and another had seven • Instructional groups varied in 
size from six to 18 children. While in some schools all groups 
had the same amount of instruction (e«g. 45 minutes per day, five 
days a week) regardless of oral fluency level, in other schools 
instructional time varied according to fluency level. For example, 
in one elementary school tvo groups of ^F" rated children met five 
days a veek in one and a half hour sessions for a total of seven 
and a half hours of instruction weekly as called for in i:he design i 
however, tvo groups of primarily "E** rated children met only twice 
a week in 30 minute periods for a total of one hour of instruction, 
and another group of rated children met once a wTOk for a 
total of only 30 minutes of instruction weekly. 

Similarly, changes were made at the secondary schools. 
Teachers serviced from three to five groups ranging in size 
from ten to 23 students. In general, instructional groups rated 
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lowest ("F" or on the oral fluency scale received the most 

instruction, up to seven hours a week, and those rated highest 
(itpw "C**) received the least, about one and a half hours a veek. 

The modifications that were made in the program design 
did result in a larger ntunber of students being serviced by the 
program than originally planned. However, the changes also meant 
that the average amount of time each student received instruction 
in English was diminished considerably • Clearly, the District 24 
i3taff must study and weigh the gains to be derived from servicing 
a large niamber of students with less instruction against the gains 
derived from providing a smaller number of students with more 
instruction. 

Another problem encountered in the program relates to the 
relatively high degree of mobility in the program population. 
As children who spoke no English were admitted to the school, it 
was necessary to transfer program participants to other ESL classes, 
if they were available, or to move students into mainstream class- 
rooms in order to provide new arrivals with needed instruction 
in English. In addition, a number of students* families moved 
and their places in the program were filled by new arrivals or 
other non-native speakers from the school population. 

To determine the extent of mobility in the program popu- 
lation, the evaluation team established a system whereby teachers 
were to submit a New Entrant, Exit, or Transfer Information Form 
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(see Appendices D and B) when a program participant's status 
was changed. Data from these records revealed that 30 to 50 per- 
cent of each teacher's original group vas exited from the program 
or transferred to other ESL groups ^ and replaced by new entrants* 

The transient nature of the non-English speaking populations 
in Nev York City is veil Known and presents a difficult problem 
for those trying to design instructional progreims for children 
from these populations. In District 24, instability in the 
program population further reduced the amount of instructional 
time students received. Often children had to be moved into 
mainstream classrooms before they had sufficient proficiency in 
English to successfully achieve in the regular classroom program. 

Instructional Program , In order to evaluate the quality 
of the classroom instruction y observations were made by an ESL 
specialist on eleven ESL teachers in the program. The ESL 
Observation Checklist (see Appendix B) was used to record ratings 
of specific instructional behaviors and the ratings of student 
behaviors. The ^cale used to indicate the quality of behaviors 
observed ranged from 0 to 4. Items on the scale which did not 
occur in the observation period were categorized as not applicable 
(NA). On the scale> 0=unacceptablej l=barely acceptablet 
2=acceptable» 3=:good, an^ 4aexGellent. In order to determine 
which instructional behaviors vere used most effectively, a rank 
order of the ratings for each behavior was established from the 
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mean ratings for the eleven ESL teachers » These data indicate 
specific behaviors that vere obsexrved and the rating of the qxiality 
of the behaviors observed. Behaviors that were not observed 
vere tallied in the N/^ category. The rank order and mean ratings 
of the observed instructional behaviors appear in Table 2. 

TABLE 2 

RANK ORDER AND MEAN RATING FOR 
OBSERVED INSTRUCTIONAL BEHAVIORS 
IN ESL CLASSES 



Frecfuencv Mean 
Rank Behavior N/A 0 1 2 3 4 Rating 



1 


Knowledge and Use of student nzunes 


0 


0 


0 


0 


0 


11 


4.00 


2 


Ask question^ then call on student 


1 


0 


0 


0 


1 


9 


3.90 


3 


Repetition after the teacher model 


3 


0 


0 


0 


3 


5 


3.63 


4 


Attitude/^anner 


0 


0 


0 


2 


2 


7 


3,45 


5 


How well was "previously learned" 
material practiced, reviewed & 
reinforced? 


1 


0 


0 


2 


2 


6 


3.40 


6 


Was the model appropriate for 
correct responses? 


2 


0 


0 


3 


2 


4 


3.11 


7 


Speech Patterni colloquial; 
normal classroom speeo 


1 


0 


1 


1 


4 


4 


3.10 


8 


How well was new material 
introduced? 


4 


0 


1 


1 


2 


3 


3.00 


8 


Did teacher recognize difference 
between teaching & testing? 


1 


0 


0 


3 


4 


3 


3.00 


8 


Distribution of student partici- 
pation among group. Are all 
students participating? 


0 


0 


2 


1 


3 


5 


3.00 


8 


HOW well was material practiced 
after introduction? 


5 


0 


0 


2 


2 


2 


3.00 


8 


How well were corrections made? 


0 


0 


0 


3 


5 


3 


3.00 


8 


How much practice with new 
material i? 


5 


0 


1 


0 


3 


2 


3.0C 
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Rank 



Behavior 



Frequency Mean 
N/A 0 12 3 4 Rating 



;8 How well was at-home follow-up 
accomplished? 

9 Awareness of student needs 

10 Response to language cues? 

11 Instructions and Cueing i Did 
students know what teacher 
expected? 

12 Was focus of lesson clear? 

12 How effective was individual 
practice? 

12 How well were audio visual aids 
employed? 

13 How well did teacher proceed 
from simple to complex? 

14 Did lesson have a b^inning^ a 
middle^ and an end? 

15 How well did teacher proceed 
from concrete to abstract? 

15 How well were students' questions 
answered by the teacher? 

16 How did teacher evaluate student 
comprehension & progress? 

17 How well did teacher proceed 
from known to unknown? 

18 How well did tf^acher proceed 
from receptive to productive? 

19 How effective was choral practice? 

20 How well were explanations made? 

20 How well was drill extended into 
communication? 

21 How effective was practice in 
speaking? 

22 How effective was practice in 
lictening 

23 Variety of activities/change 
of pace 

24 How effective was practice in 
reading? 



7 0 0 12 1 3.00 

0 1113 5 2.91 

4 0 113 2 2,86 

0 0 13 4 3 2.82 

0 0 12 3 3 2.73 

0 0 14 3 3 2.73 

0 0 3 2 15 2.73 

4 0 12 2 2 2-71 
0 12 2 2 4 2.54 

7 01030 2.50 
9 0 0 11 0 2.50 

2 0 14 3 1 2.44 

5 0 112 2 2.43 

3 0 14 2 1 2.38 

0 2 1, 2 3 3 2.36 

8 0 0 2 1 0 2.33 

2 2 112 3 2.33 

1 0 2 4 3 1 2.30 
0 0 2 5 3 1 2.27 
0 2 2 2 3 2 2.09 

9 0 0 2 0 0 2.00 
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Frequency Mean 
Rank Behavior N/A 0 1 2 3 4 Rating 

24 How well did teacher proceed 
from manipulation to commxini- 

cation? 1 23032 2.00 

25 How much did the teacher talk ? 

Ratio of teacher/student talk? 0 14321 1.82 

26 Initiation of coramtanication 

situations by students? 2 14220 1.56 

27 How effective was practice in 

writing? 9 110 0 0 .50 

28 If teacher used student's native 
language^ how effectively was it 

done? 11 0 0 0 0 0 

Scale t N/AssNot applicable 2=Acceptable 
0=Dnacceptable 3asGood 
l=Barely acceptable 4=Excellent 



It is evident in Table 2 that the two instructional 
behaviors that were used most effectively were calling students 
by name and asking questions and then calling on students. A 
teaching behavior more unique to ESL instruction ••repetition 
after the teacher model" was the next most effectively used 
behavior. The 3.63 mean rating indicates that the eight teachers 
who used this procedure (three N/A did not use it ) , used it well. 
These ratings suggest that teacher moieling and student repetition 
are ^procedures that have been stressed in the backgroimd and/or 
inservice traiping of the ESL teachers. 

The nerrt group of instructional behaviors that were 
rated good to excellent cover a variety of factors. The attitude/ 
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manner Itemy rated 3 .459 vas supported In the narrative description 
made by the evaluation team ESL sp^ialist. The comment "With 
very fev except ions, the teachers seemed interested in their 
stTsdents and in their work. Classroom rapport and empathy 
were widely noticeable, parallels the high rating in Table 2. 
Reinforcement, practice and review of previously learned materials 
was demonstrated as an instructional behavior by ten of the 11 
teachers observed and was rated good to excellent by the observer 
(3.40). These instructional behaviors, too, have obviously been 
stressed in the training provided for the ESL teachers ^ 

The items rated at 3.00 and above include appropriate 
modeling, rate and style of speech pattern, introduction of new 
material, differences between teaching and testing, distribution 
of student participation, practice of new material, the manner of 
correcting students, aitd at-home work follow-up. These instruc- 
tional behaviors were generally observed and were considered by 
the observer to be effectively used. The frequencies listed in 
the N/A category should be noted, however, for seven of the 11 
teachers did not evidence behaviors that suggested any at-home 
follow-up of English activities that were astiigned to their 
students. 

Most of the other instructional bahavlors observed wer^ 
rated acceptable (2.00) to good (3.00) and cover a variety of 
factors. Items that were rated 2.00 or lower need to be examined 
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since several of these behaviors are integrally linked to the 
objectives for the program. For example, practice in reading 
(rank ordered 24th) was used by only two of the 11 ESL teachers. 
Similarly, writing practice vas used by only two of the 11 ESL 
teachers. Although acquisition of reading and writing skills 
was only a corollary objective for the program^ it appears that 
very few teachers attempted to include reading and writing 
activities at all. This is particularly noteworthy since the 
observations were made late in the school year and it seems likely 
that some students would be ready for practice in reading and 
writing English. Teachers* use of students' native language was 
another practice totally avoided by all teachers. Theoretical 
differences about this practice still exist, yet these teachers 
all seem to accept the non-use of students' native language 
position. 

The second section of the ESL Observation Checklist 
focuses on student behaviors observed in ESL classes. The same 
0 to 4 rating scale used to assess the quality of the teacher 
behaviors is used to assess the quality of student b^avlors. 
The summary of the ratings of student behaviors observed in 11 
ESL classrooms appears in Table 3. 
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TABLE 3 

RANK ORDER Al© MEAN RATINGS FOR 
OBSERVED STUDENT BEHAVIORS 
IN ESL CLASSES 

Frecruencv Mean 
Rank Behavior N/A 0 1 2 3 4 Rating 

1 Did students seem to understand 

the teacher? 0 00128 3.64 

2 How effective was individual 
student paarticipation in 

repition? 2 00135 3.44 

3 What vas level of student interest? 0 01127 3,36 

3 What vas student attitude toward 

materials? 0 0 0 3 17 3.36 

4 Did students seem to iinderstand ^ 

the material? 0 0 0 2 4 5 3.27 

4 What was the classroom atmosphere 

Sc the rapport among students? 0 00326 3.27 

4 How effective was Individual 

student response? 0 00245 3.27 

5 Did students correct each other? 8 00300 2.00 

6 Did students use English outside 

of lesson freunework? 8 0 2 0 1 0 1.67 

7 How effective was individual 

student initiated talk? 1 24301 1.40 

Scale t N/A=Not applicable 2»acceptable 
Osunacceptable 3sgood 
l=barely acceptable 4xexcellent 



The ratings seen in Table 3 indicate that all items of 
student behaviors^ except threes were rated good to excellent. 
The students were judged by the ESL specialist observer to under- 
stand J^ieir teachers and the material » to participate in repetition, 
io be interested and to d^onstxrate a positive attitude toward 
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their classroom. The three items which were rated low on the scale 
are related to student interactiont student initiated talk and 
use of English outside the lesson frzunework. These data suggest 
that the teachers are adept in teacher directed activities but 
perhaps need additional training in facilitating student inter- 
action. 

An additional factor that must be considered in interpre- 
tation of the teacher and student ratings was observed by the ESL 
specialist. The observer noted that some students attended two 
ESL classes during different periods of the day witJi different 
teachers. The observer noted that students were being introduced 
to the same material without relating the instruction to what had 
been introduced in the other class by another teacher. The ESL 
specialist recommended a developmental sequence of instruction 
for successive levels of language learning and observed that the 
practice of overlapping and duplication mitigteted against it. 

The observations also revealed that practically no work 
was being done in connection with reading comprehension and that 
no reading books of any kind were in evidence. Ftirthermore, 
writing was limited to copying sentences and a few f ill-in-the- 
blank exercises. Also missing from the classes was any type of 
listening comprehension exercises. These observations suggest that 
the primary approach used in the ESL program is restricted to a 
limited use of English t that isf production of the language in 
carefully structured forms* 
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The ESL specialist alsc observed that not enough of the 
teachers avail themselves of the vealth of materials available 
to them. This may be simply uneasiness with somethinrj new^ lack 
of imagination in the use of materials or insufficient training. 
The observations and the ratings combine to indicate a need to 
expand concepts about second language instruction as well as a 
need to expand the goals of the program beyond oral language 
production. 

In order to examine more carefully the results of the 
classroom observation data^ individual teacher and student group 
behaviors were tallied. The mean ratings for each teacher and 
student group observed appear in Table 4. 

TABLE 4 

OVERALL RATINGS OF TEACHER EFFECTIVENESS 



Average Ratings 



Teacher 


Instructional 


Student 


No. 


Behaviors 


Behaviors 


1 


3.85 


4.00 


2 


3.81 


3.75 


3 


3.32 


3.00 


4 


3.13 


3.38 


5 


2.97 


3.50 


6 


2.62 


3.00 


7 


2.59 


3.10 


8 


2.53 


2.25 


9 


2.50 


3.14 


10 


1.52 


1,71 


11 


1.48 


2.50 



Scale: N/A=Not applicable 3=good 

l=barely acceptable 4=excellent 
2«acceptable 
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The ratings presented in Table 4 shov that four teachers 
were rated good to excellent » five teachers vere rated acceptable 
to good, and two teachers were rated barely acceptable to 
acceptable. These ratings strongly suggest that expanded in- 
service training of ESL teachers is warranted. 

The ESL specialist observed that ESL teachers in the 
elementary grades appeared to be more effective than junior high 
school teachers. The evaluators avoided presentation of the 
data separated by grade level to maintain anonymity for the ESL 
teachers observed. 

EFFECTS OF f'i^^n:^ ON CHIUJREN 

Data collected from teacher records indicated that 15 
different native languages were represented by students in the 
State Urban ESL Program, The majority of the children > 84 per- 
cent, were Spanish speaking children. District 24* s aim is to 
develop non-native speaker's language facility in English so that 
they will be able to ftmction adequately in school. To this end, 
the oral-aural approach was emphasized in teaching English as a 
second language. This section of the report presents data on 
ttie children's growth in English language skills. 

Two measures were used to assess the extent to which 
the program objective was achieved. The results are based on 
data fo all children in the program for vhom pre- and post-program 



ERLC 



-77- 

scores vere available on both of the evaluation measures. Complete 
data were available for a total of 416 pupils. 

Productive Erialish Lancmaae Proficiency . To assess 
children's growth in productive English langtiage skills^ teacher 
ratings on the Oral Language Ability Scale (OIAS) vere used. This 
scale is a modif irration of the "A-F" New York City Board of 
Education Language Rating Scale which was prepared and tested 
last year by the District ESL staff. Each child is individually 
tested and rated in five languagob areas? structural patterns, 
vocabulary^ pronunciation, situation interpretation, and intonation 
(see Appendix A). In each area the child is rated on a six-point 
scale from A=:6 to F:=0 with "F*' representing "Speaks No English." 
The ratings in each arer are summed and divided by five to obtain 
the child's English oral fluency score. 

The Oral Language Ability Scale (OlAS) was used initially 

to screen children in the target population at each school. 

Children in the "F" to "C" categojry were selected for the program, 

however, pupils in the lowest categories were to receive priority. 

Teachers' pre-program ratings on the OLAS were compared to post- 

program ratings for e^/altiation purposes. Because no control 

group was available for comparison, va- groups by test analysis was 

done in order to derive as much information from the data collected 

as possible. The subjects were divided into three groups > the 
I 

first groirfp included children in grades kindergarten to three # 
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the secor^ group inclioded grades 4 to 5^ and the third group 
included grades 7 to 9. 

The sample sizes p pre-and post- program mean ratings, the 
mean gains and the results of the analysis of variance for each 
CIAS language area and the total OIAS oral fluency score are 
presented in Table 5. 

The mean data in Table 5 reveal a language learning 
pattern that is fairly consistent across each subsection and 
the total oral fluency ^core on the OIAS c ,^ This pattern shows 
the youngest children, girades^R-^ro 3, to be the least skilled 
in English and the oldest children to be the most skilled at the 
beginning of the program. However, the post means show that 
by the end of the program children in each of the three grade,/ 
groups were similar in each of the skill areas measured, suggesting 
systematic differences in language learning among the three 
groups. As the mean gain data indicate, the kindergarten to 
grade 3 gro p made the greatest gains in all but one area, the fourth 
to sixth grad^^ .vroup made the next highest gains, and the junior 
high school sc indents in grades 7 tlirough 9 made the lowest gains. 
The systematic nature of the differences in'growtlii in English 
among the three groups is further confirmed by the results of 
the analyses of var^nce. 
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As Table 5 shows all F-ratios for Tests (T) are highly 
significant (p-^.OOl) indicating that for tho total ESL sample, 
regardless of grade level, children in the program made signifi- 
cant pre- to post-test gains in each language skill area. 
However, as the interaction (GxT) F-ratios also show, the o 
differences among the three grade groups were highly significant 
(p<:^.001). These findings support the conclusion that, based 
on teachers* ratings of children's English language skills, tho 
ESL Program was the most successful with children in the lowest 
grades (K-3) and the least s?:!ccessful with children in the 
highest grades (7-9). 

The results in District 24 are not inconsistent with 
general knowledge in the field of language learning. Language 

o 

o 

gains are generally greater among younger children. 

The total scores on the OLAS were used in another analysis 
which compares the number of pupils at each general oral fluency 
level at the beginning of the program with the number at each 
level at the end of the program. The findings are presented 
in Table 6. 
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TABLE 6 

COMPARISON OF NUMBER AND PERCENTAGE AT EACH 
ORAL lANGUAGE FLUENCY LEVEL AT THE 
<;? BEGINNING AND END OF THE PROGRAM 



Pre-test Oral Post-test Oral Fluency Level 



Fluency Level P E D C 



Ratina 


N 




N 


{%) 


N 




N 




N 




F 


157 


(38) 


7 


(4) 


52 


(33) 


93 


(59) 


5 


( 3) 


E 


111 


(27) 


0 


(0) 


10 


( 9) 


93 


(84) 


8 


( 7) 


D 


121 


(29) 


0 


(0) 


2 


( 2) 


79 


(65) 


40 


(33) 


C 


27 


( 6) 


0 


(0) 


0 


( 0) 


8 


(30) 


19 


(70) 


Total 


416 


(100) 


7 


(2) 


64 


(15) 


273 


(66) 


72 


(17) 



As Table 6 shows, 38 percent of the evaluation sample 
vere rated ••F",in oral fluency at the beginning of the program, 
\diile 27 percent, 29 percent and 6 percent were rated "E," 'T)," 
and •*C," respectively, by their ESL teachers. By the end of the 
program only two percent were rated "F," 15 percent were rated 
66 percent were rated **D" and 17 percent were rated "C," 

The data do show, however, a definite trend in favor of 
those children rated lowest in English at the beginning of the 
program. The pattexm that evolves is one in which teachers 
tend to rate more of the children rated "F** as having moved up 
more levels in English proficiency than children in any of the 
other oral fluency levels. As Table 6 indicates, based on 
teachers^ ratings, 33 percent of the cdiildren rated lowest (F) 
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initially moved one level to "E,- 59 percent of this group moored 
two levels to "T)," and three percent moved three levels to a 
rating. Hoveverj, those children with^^the most facility in English 
at the beginning of the program (C level) according to their own 
teachers* assessment, made no gain in their basic oral fluency 
level. In fact, 30 percent of the children rated *'C" at the 
beginning of the prograuu were rated one level lower at the end 
of the program and the remaining 70 percent were rated at the 
same level. 

These findings indicate that teachers* subjective ratings 
on language measures, such as tl>e CIAS, are inadequate measures 
for discriminating among finer levels of pupil growth in English 
as a second language. It is possible that the children in the 
program who initially had the least proficiency in English were 
actually the ones who made the greatest gains, especially since 
these children generally received the moet instruction. It is 
possible, however, that teachers' post- program ratings were 
somewhat inflated since children who speak no English at all at 
the beginning of the program will likely appear to have made 
extensive gain if they speak any English at all at the end of 
the program. Consider, too, that it is iinlikely that all of 
the children rated at the highest level of proficiency (C) made 
no gains in basic oral fluency in English by the end of the program. 
These children received not only special instruction in English 
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as a second language, taut regular classroom instruction also, 

■O' 

The more reasonable explanation relates to the basic inadequacy 
of the oral fluency scale in discriminating language grovth 
among children with some reasonable facility in English, As 
indicated in last year's report, measures like the "A to F** 
scale "can clearly be used to identify F-rated children, those 
vho are unable to respond satisfactorily. It is less appropriate 
for discriminating among E, D or C level children," 

Receptive English Language Proficiency . In order to 
obtain a more objective measure of pupil growth in English as a 
second language, arrangements were made to administer the Linguistic 
Capacity Index ilCl) on a pre- and post-program basis. This test 
was developed as a measure of English language readiness and has 
been used to assess pupil achievement in learning English as a 
foreign language. 

The LCI is a receptive language measure consisting of 
three sections; vocabulary recognition, contrastive phonology, 
and contrastive grammar. A total score is derived from the sura 
of the three subsection scores. Table 7 presents the sample sizes, 
pre- and post-program means, the mean gain and the results of the 
groups by test analyses of variance for each subtest and the total 
score on the Linguistic Capacity Index . 
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The pre-tGSt means shown in Table 7 reveal a consistent 
pattern among the grotips of students in grades kindergarten through 
the third grade, fourth through sixth, and seventh through ninth. 
For vocabulary recognition, contrastive phonology, eontrastive 
grammar and the total score, as measured by the LCI, the mean 
scores gradually increased on the pre-test as the groups 
increased in grade level. The post -test means follow a similar 

pattern across grade levels, however, the gain scores reveal a 

I 

pattern which is nearly reversed. The gain scores in Table 7 
show that the K-3 group gained more than the 4-6 group in all 
three subsections and the total score of the ix:i, and that the 
4-5 group gained more than the 7-9 group on two of the subsections 
and the total score of the LCI. The exception to the pattern 
e/ident in the gain scores occurs in the contrastive phonology 
subtest. In this instance, the 7-9 group gained more than either 
the K-3 group or the 4-6 group. 

The analysis of variance results in Table 7 show that all 
F-ratios for Tests (T) are highly significant (p^.OOl) indicating 
that on the LCI measure, also, program participants as a whole 
made significant pre- to post'-program gains in each language skill 
area. The analysis of variance results further indicate that 
the age related pattern of the gains (younger groups gained more) 
were significant. The one exception to this pattern is shown in 
the contrastive phonology subtest of the LCI. The interaction (GxT) 
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F-ratio for this subtest was not significant indicating that 
although the oldest students made greater gains than the other 
tvo groups, the differences among the group gains were not, 
significantly different. The interaction {Gi^) F-ratios for 
vocabulary recognition, contrastive grairanar and total score on 
the LCI were significant. These data support the findings 
discussed from the OIAS teacher ratings. The E3L program was 
more effective at the lower grade levels than it was at the 
upper grade levels. 

While the age related nature of language learning facility 
may be the major factor to account for these results, additional 
factors should be considered. The additional factors may include 
variation in instructional approaches and teacher effectiveness 
at the elementary and junior high schools. Observations of the 
classroom program indicated a general trend that showed instruc- 
tion to be more appropriate for children at the elementary level 
than it was at the junior high school. Further examination of 
ways to improve ESL teaching effectiveness, particularly 
at the upper grade levels, is clearly warranted. 

SUMMARY AND CONCLUSIONS 

Examination of program records, classroom observations 
and interviews with the ESL staff revealed the following, 

1. Major changes in the planned program design were 
made at each school. These changes did result in more students 
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being serviced by the program than originally planned, but the 
changes also resulted in a concomitant reduction in the average 
amount of instruction in English received by students in the 
program. 

2. The high mobility of the non-English speaking 
student population brought some instability to the instructional 
program and further reduced the amount of instruction students 
received. A number of students were transferred to the mainstream 
program before their language facility vas adequate for academic 
success in a regular classroom program. 

3. A vide range of ESL teacher competence was observed. 
In generals ESL teachers vere skilled in a narrow range of 
teaching behaviors related to second language learning. 

Analysis of pupil perfomance on the Oral Language Ability 
Scale and the Linguistic Capacity Index resulted in the following 
findings. 

1. For the total ESL sample^ regardless of grade level, 
students in the program showed significant pre-to post-test gains in 
all receptive and productive English language skill areas. 

2, A consistent age related pattern of language learning 
emerged from the data. Children in grades kindergarten through 
grade 3 showed the greatest growth in English proficiency, 
students in grades 4 through 6 demonstrated somewhat less growth. 
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while students in grades 7 to 9 demonstrated the least amotint of 
growth in English proficiency* 

While the data did sihow that students in the ESL program 
made significant gains in their ability to understand and speak 
English, no conclusive statement can be made about the program's 
effectiveness since no comparison group was available* It is 
difficult to conclude, therefore, that the gains made by the 
students in the ESL program were greater than those that might 
havo been expected from students in a regular program with no 
specialized instruction in English, 

RECOMMENDATIONS 

Based cn the findirxgs of this evaluation of the ESL 
program, the following recommendations are made, 

1, An effort must be made to structure the ESL program 
so that students will receive consistent and adequate amounts 
of instruction in the use of English coramensurate with their 
level of language proficiency, 

2. A study should be made of the extent and nature of 
the population mobility in each school in order to design a 
program that would provide stable instruction for larger nvanbers 
of students. Provisions must be made to offer new arrivals 
needed instruction in English without transferring students to 
the mainstream before they are proficient enough in English to 
succeed academically. 
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3. There is a need to recruit teachers for the program 
who have been adequately trained in ESL techniques or to expand 
the inservice training in order to improve the present ESL 
teachers* effectiveness. 

o§ ^ 4P While oral fluency in English is essential as a 
valid objective, the ESL program should be expanded to include 
the tool subjects of reading and writing in English if students 
are to successfully achieve in the regular school curriculum* 

5. Because of the subjective nature of teacher ratings, 
it is suggested that whenever possible more objective measures, 
such as the Linguistic Capacity Index , also be used. Multiple 
measures provide more accurate information for pupil selection, 
for diagnosis of children's languaqe strengths and weaknesses, 
and for assessment of pupil achievement in learning English 

as a second language* 

6. Analysis of pre- and post-program scores showed that 
the youngest children in the program (grades kindergarten to 3) 
made the greatest gains. Although the greater language learning 
facility generally found among younger children may account for 
this finding^ other factors such as differences in instructional 
approach, program structure and teacher effectiveness may have 
been operating. These and other factors should be examined in 
order to determine how the effectiveness of the program might 

be increased in the upper grades. 
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APPENDIX A 

CORRECTIVE READING PROGRAM - DISTRICT 24 

New York University 
The Center for Field Research and School Services 

READING TEACHER QUESTIONNAIRE 



School , Date 



Reading Teacher's Nsune Code (leave blarik)^ 



Fundings 1. Title I 2. Optional Assign. 3. State urban^ 

PLEASE NOTE x All responses will be held in strict confidence and 
will be used only for evaluation of the program. 
No person connected with the school or the Board 
of Education will have access to these data. 



SECTION A - EVALUATION OF INSERVICE TRAINING 

The following questions are aimed at an assessment of the inservice 
training provided for Corrective Reading Teachers as part of 
this year*s program. We ask for your honest appraisal of this 
aspect of the progreun. 

(? 

1. Instructions > Listed below are topics which may have been 
covered during the afternoon staff m eetincts . Use the raiting 
scale billow to evaluate the adequacy with which each was 
covered during training sessions. Put your rating in the 
space provided before the topic. For any item that was not 
covered, write NC. 

Scale t 5=Very Satisfactory, 4aAbove Average, 3=Averagej> 

2=Barely Satisfactory, InsUnsatisfactory, NC=Not Covered 

Rating Topic 

(a) Organization t administration and supervision of 
the program 



(b) Objectives and rationale for the program 
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Rating Topic 

Criteria for selection of proqram participants 
Procedures for selection of student participants 
Specific procedures for diagnosis 
Knowledge of reading skills 
Methods of corrective instruction 
Use of instructional materials 

Teacher selection and evaluation of program material 
Organizing the class for instruction 
Techniques for evaluating pupil progress 
Record-keeping policies and procedures 
Techniques for using paraprof essionals in the program 
Techniques for parent involvement 

Other (Please specify) 



(c 
(d 
(e 
(f 

(g 

(h 
(i 

(j 
(k 
(1 
(m 
(n 
(o 



2. 



3. 



In your opinion, was the amount of inservice training sufficient? 

1. No 2. Yes 

Please give your overall rating of the inservice training 
provided for Corrective Reading Teachers this year. 



1 • Unsatisfactory^ 
3 . Average 



2. Barely Satisfactory^ 



4. Above Average^ 



5. Very Satisf actory_ 



4. Did you participate in the Corrective Reading Program last 
year (1971-72)? 



1. No 



2. Yes 
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5. If your answer to question 4 is yes, how would you evaluate 
this year's training program in comparison to last year's 
sessions? On the whole, this year's training was: 

1. 2. 3. 

Inferior About the same Superior 

Please feel free to write additional comments about the i iservice 
training provided by the program and your suggestions for 
improvement . 



SECTION B - READING TEACaiER EVALUATION OF PROGRAM EFFECTIVENESS 

1, Listed below are itens related to different aspects of the 

Corrective Reading Program, Use the following rating system 
to evaluate the quality and/or effectiveness of each aspect 
of the program, 

l»Unsatisfactory, 2=Barely Satisfactory, 3=Average, 
4=Above Average, 5=Very satisfactory, NA=Not Appropriate 

Program Organization 

Rating Item 

(a) Organization of the program (number of classes, 

scheduling, etc, ) 

(b) Amount of time allocated for pupils receiving 

corrective reading instruction 

(c) Nicnber of pupils in each group 

(d) Overall Rating for Program Organization 
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Pupil Selection 

Rating Item 

^ (a) Criteria used to select pupils for the Corrective 

Reading Program 

(b) Procedures used to select pupil participants 

(c) Assignment of pupils to instructional groups on basis 

of severity of reading retardation 

(d) Overall Rating for Pupil Selection 



Need 



(a) Number of students serviced by the program compared 
to number who need corrective reading instruction 

Physical Facilities and Materials 

(a) Size of the room provided by the school 

(b) Physical facilities in the room 

(c) Adequacy of the types of instructional (workbooks, 

literature, audio visual aids, etc.) materials in the 
program 

(d) Quantity of materials provided for the number of 

children serviced 

(e) Availability of materials at the start of the program 

(f) Overall Rating for Facilities and Materials 



Procedures for Diagnosis and Evaluation 

(a) Use of the Informal Reading Inventory to establish 

reading levels and to evaluate growth in reading 

(b) Use of the Metropolitan Reading Test to evaluate 

growth in reading 

(c) Use of the Stanford Diagnostic Test to assess 
individual weaknesses and strengths in reading 
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Rating Item 

(d) Adequacy of materials and instruments supplied for 

diagnosis and evaluation 

(e) Appropriateness of the record keeping systeir 

established for the program 

(f ) Overall rating for Diagnostic and Evaluative Procedures 

and materials used in the program 

S tudents 

(a) Pupils' attitude toward the corrective reading classes 

(b) Observable improvement in pupil performance 

Parental Involvement and Attitude 

(a) Extent of parent involvement in the Corrective 

Reading Program 

(b) Parent's attitude toward the program 

(c) Time to confer with parents through individual and/or 
group conferences 

Personnel Support 

(a) Cooperation of school personJ)el generally 

(b) Communication between classroom teachers and yourself 

about pupil progress 

(c) Extent to which reading materials, procedures, and 

techniques used in the Corrective Reading Program 
have been adapted by classroom teachers 

(d) Amount of time provided to confer with classroom teachers 

(e) Classroom teachers* attitudes toward Corrective 

Reading Program 

(f) Supervision and assistance provided by the reading 

coordinator 
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2. Did you participate in the Corrective Reading Program last 
year? 

1. No 2. Yes 



3. If your answer to question 2 is yes, what is your overall 
impression when you compare this year's program to last 
year's program? This year's Corrective Reading Program iss 

1. 2. 3. ^ 

Inferior About the same Superior 

4. Would you be interested in participating in a similar program next 
year? 

1. Yes 2. No 3. Not sure 



Please feel free to write additional comments about the program 
and suggestions for improvement. (We would be interested especially 
in your comments about those aspects of the program you rated low 
in item 1 above . ) 



SECTION C - READING TEACHER EVALUATION OF SUPPORTIVE SERVICES 
1 . Pa ra pro f es s i ona 1 s 

(a) How many para professionals were assigned to your 
reading program? 

(b) Could you have used additional paraprofessionals? 
Yes No 
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(c) When did they begin working? 



(d) Did the paraprofessionals receive any special training 
for the program? 

Yes No 



If yes, vho provided the training? 



(e) Briefly describe responsibilities asstimed by the para pro- 
fessionaKs) in your program. 



(f) Please rate the adequacy of the paraprofessionals pre- 
paration and skills for the program 

1 2 3 4 

Inadequate Barely Satisfactory Above Average 

Satisfactory 

5 

Very Satisfactory 

(g) What is your overall rating of the services provided by 
the paraprofessionals? 

1 2 3 4_ 

Unsatisfactory Barely Average Above Average 

Satisfactory 

5 

Very Satisfactory 

(h) Indicate your suggestions for improving the contributions 
that can be made by paraprofessionals in this Corrective 
Reading Program. 
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2# Guidance Services (Optional Assignment Program) 

(a) Approximately how many of your corrective reading 

students received the services of the guidance counselor? 



(b) How would you rate the frequency of your contacts with 
the guidance counselor regarding your students? 

1 2 3 4 5 

None Rarely Occasionally Frequently Very Often 

(c) How would you rate the quality of your contacts with the 
guidance counselor? That ist to vhat degree did his/her 
services help in leadinrr to the resolution of students* 
problems? 

1 2 3 4 5 

Not helpful Helpful Very Helpful 

(d) What suggestions do you have for improving the guidance 
services provided for optional assignment students in 
the reading program? 



SECTION D - READING TEACHER BACKGROUND INFORMATION 
EDUCATIONAL BACKGROUND 

Degree Year Institution Major Field 



-99- 



COURSE WORK RELEVANT TO TEACHING CORRECTIVE READING 

Check those courses which you have taXen and indicate the 
institution and year, (Do not include inservice courses here. ) 

Content of Course Institution Year 

Foundations of Reading Instruction 

Diagnostic Techniques - Reading 

Corrective" Riaading Instruction ' 

Reading in the Content Areas 

^Teac^iing Individualized Reading 

Other 



TEACHING EXPERIENCE 

School Grades No> of Years Regular or Substitut< 



EXPERIENCES SPECIFIC TO TEACHING CORRECTIVE READING 

Check those experiences which you have had nd the number of years 

Experience No> of Years 

Corrective Reading - Public Schools 

^After-school Tutorial Reading Program 

Pa rent- volunteer Reading Tutor 

Priva/ce tutorial work in Reading 

Other 
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INSERVICE COURSES IN CORRECTIVE READING 

List the inservice courses relevant to Corrective Reading 
which you took before this academic year. 

Course Year 



PRESENT INSERVICE COURSES 

List any inservice courses related to Corrective Reading which 
you have taken this year. 

Course Instructor 
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APPENDIX B 

C ORRECTIVE REM)ING PROGRAM - DISTRICT 24 

New York University 
The Center for Field Research and School Servict^s 

PRINCIPAL'S QUESTIONNAIRE 



NAME DATE 

SCHOOL ^ 



PLEASE NOTE J All responses will be held in strict confidence and 
will be used only for evaliiating the program and 
for making recommendations for improvement. No 
person connected with the school or the Board of 
Education will have access to these data, 

SECTION A - EVALUATION OF INSERVICE TRAINING 

The following questions are aimed at an assessment of the inservice 

training provided for Corrective Reading Teachers as part of 

this year's program. Please answer to the best of your knowledge. 

1. In your opinion, was the amount of inservice training sufficient? 
1. No 2. Yes 3. Don't know 

2. Give your overall rating of the adequacy of the inservice 
training that was provided for Corrective Reading Teachers. 

1. Unsatisfactory 2. Barely satisfactory 

3. Average 4. Above Average 5. Very satisfactory 

(DK) Don't Know 

3. Did any of your teachers participate in the Reimbursable 
Corrective Reading Program last year (1971-72)? 

1. No 2. Yes 
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4. If your answer to question 3 is yes^ how would you evaluate 
this year's inservice training program in conparison to 
last year's. On the whole, this year's training wast 

1 2 3 

Inferior About the same Superior 

Please feel free to write additional comments about the inservice 
training provided for teachers in the Corrective Reading Program, 



SECTION B PRINCIPALS' EVALUATION OF PROGRAM EFFECTIVENESS 

1. Instructions ! Listed below are itens about aspects of the 

Corrective Reading Program in District 24. Use the following 
scale to evaluate the quality and/or the effectiveness of the 
reading program. 

Scalei l=Unsatisfactory, 2=:Barely Satisfactory, 3=Average, 
4=Above Average, 5=Very Satisfactory 

Program Organization 

Rating Item 

(a) Organization of the program (including number of 

classes, scheduling of classes, etc.) 

(b) Amount of time allocated to corrective reading 

instruction 

(c) Number of pupils in each reading group 

(d) Overall Rating for Program Organization 
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Pupll Selection 

Rating Item 

(a) Criteria used to select pupils for the Corrective 

Reading Program 

(b) Procedures used to select pupil participants 

(c) Assignment of pupils to instructional groups on 

the basis of e^everity of reading retardation 

(d) Overall Rating for this area 



Need 



(a) Number of students serviced by the program compared 

to the number vho need corrective reading instruction 

Physical Facilities and Materials 

(a) Size of the room(s) provided for the program 

(b) Physical facilities in the room(s) 

(c) Adequacy of the types of instructional materials 

(textSf workbooks, literature, audiovisual, etc*) 
used in the program 

(d) Quantity of materials provided for the number of 

children serviced 

(e) Availability of materials at the start of the program 

(f) Overall Rating for this area 



Procedures for Diagnosis and Evaluation 

(a) Use of the Metropolitan Reading Test to evaluate 

growth in reading 



(b) Use of the Stanford Diagnostic Test to assess individual 
strengths and weaknesses in reading 



-104- 



Rating Item 

(c) Appropriateness of the materials and instriaments 

used for diagnosis and evaluation 

(d) Appropriateness of the record keeping system established 
for the program 

(e) Overall Rating for this area 



Students 

• (a) Students' attitude toward corrective reading classes 
(b) Observable improvement in pupil performance 

Parental Involvement and Attitude 

(a) Extent of parent involvement in the Corrective Reading 

Program 

(b) Parents * attitude toward the program 

(c) Time for teachers to confer with parents through 

individual and/or group conferences 



Personnel Support 

(a) Cooperation of school personnel generally 

(b) Communication between corrective reading teacher(s) 

and classroom teachers about pupil progress 

(c) Extent to which reading materials > procedures, and 

techniques used in the Corrective Reading Program 
have been adapted by classroom teachers 

(d) Amount of time available for corrective reading 
teachers to confer with classroom teachers 
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Ratinq Item 

____ (e) Classroom teachers' attitude toward the program 

(f) Quality of the services provided by the paraprof essionals 

_____ (g) Teachers' ability to use paraprof essionals effectively 
in the program 

(h) Adequacy of the corrective reading teachers* preparation 

and skills required for the program 

\ (i) Quality of the instruction generally provided by 

the corrective reading teachers 

^ ( j) Ongoing supervision and guidance provided by the 

reading coordinator 

2. Did your school participate in the Corrective Reading Program 
last year (1971-72)? 

1. No 2. Yes 



3. If your answer to question 2 is yes, how would you evaluate 
this year's program in comparison to last year's? 



Inferior About the same Superior 

4. Would you be interested in your school participating in a 
similar prc^ram next year? 

1. No 2. Yes 3. Not sure 



Please feel free to write additional comments about the program 
and suggestions for improvement. We would be especially interested 
in your comments about those aspects of the program you rated low 
in item 1 above. 
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Name 



APPENDIX C 

CORRECTIVE READING PROGRAM - DISTRICT 24 

New York University 
The Center for Field Research and School Seirvices 

READING COORDINATOR'S EVALUATION 
OF CORRECTIVE READING PROGRAM 

Date 



PLEASE NOTES All responses will be held in strict confidence 

and will be used only for evaluation of the program. 



SECTION A - EVALUATION C;F INSERVICE TRAINING 

1. Instructions ! Listed below are topics x^hich may have been 

covered during the afternoon staff meetings. Using the scale 
below, indicate the extent to which each topic was adequately 
covered during these sessions. 



Sea let 



Rating 



(a 

(b 
(c 
(d 
(e 
(f 

(g 

(h 
(i 



5=Very staisfactory, 4=Above average, 3=Average, 
2=Barely satisfactory, l=Unsatisfactory, NC=Not covered 

Topic 

Organization, administration and supervision of 
the program " 

Objectives and rationale for the program 

Criteria for selection of program participants 

Procedures for selection of student participants 

Specific procedures for diagnosis 

Knowledge of reading skills 

Methods of corrective instruction 

Use of instructional materials 

Teacher selection and evaluation of program 
materials 
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Rating Topic 

( j) Organizing the class for instnictlon 

(k) Techniques for evaluating pupil progress 

(1) Record keeping policies and procedures 

(m) Techniques for using paraprofesslon^^ls in the program 

(n) Techniques for parent Involvement 

____ (o) other (Please specify) 

2, In your opinion^ vas the amount of inservlee training sufficient? 

1. No 2. Yes 

3* Please give your overall rating of the Insexrvice training 
provided for Corrective Reading Teachers this year. 

1. Unsatisfactory 2. Barely satisfactory 

3. Average 4. Above average 5. Very satisfactory 

4. How would you evaluate this year's training program in 

comparison to last year's sessions? On the wholes this year's 
training vast 



Inferior About the same Superior 

Please feel free to write additional comments about the inservice 
training provided by the program this yemr and your suggestions 
for improvement . 
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SECTIOW B - COORDINATOR'S EVALUATION OF PROGRAM EFFECTIVENESS 

1. Listed below are items related to aspects of the Corrective 
Reading Program. Use the following rating system to evaluate 
the quality and/or effectiveness of each aspect of the program. 

Scale: l=Unsatisfactory, 2=:Barely satisfactory, 3=Average, 

4=Above average, 5=Very satisfactory, NA=:Not appropriate 

Program Organization 

Rating Item 

(a) Organization of the program (number of classes # 

scheduling, etc.) 

(b) Amount of time allocated for pupils receiving 

corrective reading instruction 

(c) Number of pupils in each group 

(d) Overall Rating for Program Organization 



Pupil Selection 

(a) Criteria used to select pupils for the Corrective 

Reading Program 

(b) Procedures used to select pupil participants 

(c) Assignment of pupils to instructional groups on 

the basis of severity of reading retardation 

(d) Overall Rating for Pupil Selection 

Need 

(a) Number of students serviced by the program compared 

to the number who need corrective reading instruction 
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Phvsical Facilities and Materials 



Rating 


Item 


vaj 


Size Or tne roomvs; proviaeQ ror tne program 


(b) 


Physical facilities in the room(s) 


(c) 


Adequacy of the types of instructional materials 




(texts^ workbooks, literature, audio visual aids. 




etc . ) used in the program 


(d) 


Quantity of materials provided for the number of 




ch i Idren serviced 


(e) 


AvaiiaDillty or materials at tne start or tne program 


(f) 


Overall Rating for Facilities and Materials 


Procedures 


for Diaanosis and Evaluation 


(a) 


Use of the Informal Inventory to establish reading 




levels and to evaluate growtn in reaaing 


(b) 


Use of the Metropolitan Readina Test to evaluate 




growtn m reaai,ng 


(c) 


Use of the Stanford Diagnostic Test to assess 




individual weaknesses and strengths in reading 


(d) 


Adequacy of materials and instruments used for 




diagnosis and evaluation 


(e) 


Appropriateness of the record keeping system 




established for the program 


\T J 




Students 




(a) 


students' attitude toward the program 


(b) 


Observable improvement in pupil performance 



o 
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Parental Involvement and Attitude 



Rating 



(a 

(b 
(c 



Personnel Support 



Item 

Extent of parental involvement in the Corrective 
Reading Program 

Parents • attitude toward the program 

Time for teachers to confer with parents through 
individual and/or group conferences 



(a) Cooperation of school personnel generally 

(b) Communication between corrective reading teachers 
and classroom teachers about pupil progress 

(c) Extent to which ideas, reading materials, procedures, 
and techniques used in the Corrective Reading Program 
have been adapted by classroom teachers 

(d) Amount of time available for corrective reading 
teachers to confer with classroom teachers 

(e) Classroom teachers* attitude toward the program 

(f) Quality of the services provided by the paraprofessionals 

(g) Teachers* satisfaction with the services provided by 
the paraprofessionals 

(h) Teachers* ability to use paraprofessionals effectively 
in the program 

(i) Adequacy of the corrective reading teachers* pre- 
paration and skills required for the program 

(j) Quality of the instruction generally provided by 
the corrective reading teachers 
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3. What is your overall impression when you compare this year's 
program to last year*s7 This year's Corrective Reading 
Program ist 

1 2 3 

Inferior About the same Superior 

Please give your general evaluation of the program, indicating 
specific strengths and weaknesses. Feel free to comment on or 
to give reasons for your ratings in 1 and 2 above. 



ERIC 



-112- 



APPENDIX D 

CORRECTIVE READING PROGRAM - DISTRICT 24 

New York University 
The Center for Field Research and School Services 

QUESTIONNAIRE FOR CIASSROOM TEACHERS 
WITH STUDENTS IN THE REIMBURSABLE CORRECTIVE READING PROGRAM 



YOUR NAME ^ I>ATE 

SCHOOL " 

PLEASE NOTE I All responses will be held in strict confidence and 
will be used only for evaluation of the program. 
No person connected with the school or the Board of 
Education will have access to these data. 

1. How many children in your class(es) participate in the Title I, 
Optional Assignment or State Urban Corrective Reading Program 
this year? . . , 

2. Instructions I Listed below are items about aspects of the 
Corrective Reading Program. Use the following rating system 
to evaluate the effectiveness of the reading program i 

Scale: l=Unsatisf actory, 2=Barely Satisfactory, 3=Satisfactory, 
4=Above Average, 5=Very Satisfactory, NA=Not Appropriate 

Program Organization 

Rating Item 

(a) Organization and scheduling of corrective reading 

classes 

(b) Amount of time allocated for pupils receiving 

corrective reading instruction 

(c) Overall Rating for this area 



Need 

(a) Number of children serviced by the program compared 

to number who need corrective reading instruction 
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Pupil Selection ^ 
Rating Item 

____ (a) Criteria used to select pupils for the Corrective 
Reading Program 

(b) Procedures used to select pupils 

(c) Overall Ratincr for this area 



Student and Parent Attitudes 

(a) Students' attitude toward corrective reading classes 

(b) Observable improvement in students* reading per- 
formance during regular class activities 

(c) Parents* attitude toward children's participation in 

the Corrective Reading Program 



Support 

(a) Communication between corrective reading teacher (s) 

and yourself about pupil progress 

(b) Extent to which you have adapted ideas, materials, 

procedures and techniques used in the Corrective 
Reading Program 

(c) Amount of time available to confer with corrective 

reading teacher(s) 

Did any children in your class last year participate in the 
Corrective Reading Program (1971-72)? 

1 . No 2 • Yes 

If your answer to 3 is yes, how would you evaluate this 
year's program in comparison to last year's? On the whole, 
this year's program is: 

1 2 3 

Inferior About the same Superior 
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5. Would you be interested in your pupils participating in a 
similar program next year? 

1 . No 2 . Yes 3 . Not sure 



Please feel free to write additional comments about the program 
and suggestions for improvement. 
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APPENDIX E 
INDEX OF READING ATTITUDE 

School Name 

Teacher ^ Grade Date 



Circle the number which most closely tells how you feel about 
each of the statements listed below. 

1 - almost always 

2 - often 

3 - sometimes 

4 - not often 

5 - almost never 



1. 


Reading makes me feel good. 


1 


2 


3 


4 


5 


2. 


I read the newspaper. 


1 


2 


3 


4 


5 


3. 


I read before I go to bed. 


1 


2 


3 


4 


5 


4. 


Free reading time is the best part 
of school. 


1 


2 


3 


4 


5 


5. 


I HKg it when the teacher reads aloud. 


1 


2 


3 


4 


5 


6. 


I talk about books I have read. 


1 


2 


3 


4 


5 


7. 


I am a good reader for my age. 


1 


2 


3 


4 


5 


8. 


I get good grades on reading tests. 


1 


2 


3 


4 


5 


9. 


I read when I can do what I want to do. 


1 


2 


3 


4 


T} 


10. 


Reading is my favorite subject at school. 


1 


2 


3 


4 


5 


11. 


I read magazines. 


1 


2 


3 


4 


5 


12. 


I read comic books. 


1 


2 


3 


4 


5 


13. 


I like to read paperbacks. 


1 


2 


3 


4 


5 


14. 


I like to talk about books I have read. 


1 


2 


3 


4 


5 


15. 


I like to read aloud. 


1 


2 


3 


4 


5 
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APPENDIX B 

DISTRICT 24 
ESL OBSSKVATION CHECKLIST 

Sea let NA=not applicable! Ostmacceptable * l^barely acceptable; 
23accei>tablei 3sgood| 43excellent 



Instructional Behaviora N/\ 0 12 3 4 

1. Attitude/Wanner 

2. Kncwledge and Use of student names 

3. Ask questionf then call on student . . 

4. Amreness of Student Needs ; 

5. Speech Patterns colloquial i nomal 

classroom speed 

6. Hov much did the teacher talk ? 

Ratio of teacher/student talk? 

?• Wjas focus of lesson clear? 

8. Hov veil vas nev material introduced? 

9. Hov rrell vas material practiced after 

int roduct ion? 

10. Hov much practice vith nev material? . 

11. Hov veil vas drill extended into 

communication? 

12. Was the model appropriate for 

correct responses? 

13. Instructions and Cuaings Did 

students knov vhat teacher expected? 

14. Variety of activities/change of pace 

15. Distribution of student participation 
aunong group « Are all students 

participating? I | I ^ 
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Instructional Behaviors 



N>^ 0,1234 



16. How well was "previously learned" 
material practiced ^ reviewed & 
reinforced? 

17. How i(rell were corrections made? 

18. How well were students^ questions 
answered by the teacher? 

19. How well were explanations made? 

20. How well was at-home follow-up 
accomplished? 

21 • How well were audio visual aids 
employed? 

22. Did teacher recognize difference 
between teaching & testing? 

23. Did lesson have a beginning, a 
middle and an end? 

24. How well did teacher proceed 
from known to unknown? 

25. How well did teacher proceed 
from simple to complex? 

26. How well did teacher proceed 
from receptive to productive? 

27. How well did teacher proceed 
from concrete to abstract? 

28. How well did teacher proceed 
f rem manipulation to communi- 
cation? 

29. How effective was practice in 
listening? 

30. How effective was practice in 
speaking? 

31. How effective was p^ractice in 
reading? 

32* How effective was practice in 
writing? 

33. How effective was choral 
practice? 
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Instructional Behaviors N/A 0 12 3 4 

34. How effective individual 

practice? 

35. If teacher used student's native 
language f how effectively was it 

done? 

36. Repetition after the teacher model? 

37. Response to language cues? . 

38. Initiation of commtinication 

situations by students? 

39. How did teacher evaltiate student 

comprehension & progress? } I I I I I 



Student Behaviors N/A 0 12 3 4 

1. What wao the classroom atmosphere 

& the irapport among students? . 

2. What was level of student interest? „ . . 

3. What was student attitude toward 

materials? . 

How effective was individual student 
participation int 

4 . r epet it ion? 

5. response? 

6. initiation? . 

7. Did students seem to understand 

the teacher? | 

8. Did students seem to understand 

the material? 

9. Did students use English outside 

of lesson fraunework? 

10. Did students correct each other? I I I 1 ' 
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APPENDIX C 

DISTRICT 24 
ESL NEW ENTRANT INFORMATION FORM 
1972-1973 



Fill out this form for each new sttident vho enters your 
prov:jram and send to the ESL Coordinator alona with the child's 
Scal e for Ratixwr Oral Lancmage Ability and his/her Linguistic 
Capacity Index Booklet , 



Child's Name 

(First) (Last) 

School Grade Native Language 

ESL Teacher Instructional Group # 

Instruction Period (s)s 



Day 


Fran 


to 


Day- 


From 


to 


Day 


From 


to 


Day 


From 


to 



Date Child Entered Program 



Comments 
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APPENDIX D 

DISTRICT 24 
ESL EXIT INFORMATION FORM 

Please complete this form for each student vho leaves 
your program before the end of the year. If the child has been 
in the program for at least one months then submit the child's 
post test Scale for Rating Oral Lancruage Ability and his/her post 
test Linguistic Capacity Index Booklet. 



Child's Name 

(First) (Last) 



School Grade ESL Teacher 



Date Child Entered Program 



Month Day Year 

Date Child Left Program 



Month Day Year 
Reason for Exit 



Send this form to the ESL Coordinator at the District 
Office. Include post test rating scale record form and 
Linguistic Capacity Index booklet if child was In the program 
for at least one month. 
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APPENDIX E 

DISTRICT 24 
ESL TRANSFER INFORMATION FORM 
1972-1973 

Fill out this form for each student ^o is transferred 
to another ESL group or teacher and return to the ESL Coordinator. 



Child's Name 
School 



Student transferred tot 

A. New group Instructional Period(s)t 



Day 


From 


to 


Day 


From 


to 


Day 


From 


to 


Day 


From 


to 


Day 


From 


to 



B. Another teacher 
Reason for the transfer 



(First) ^ (Last) 
Grade ESL Teacher 
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EXECUTIVE iSlWlARY 



Durinq tho 1972-1973 school year tho oducationnl proqrnm 
in Community School District 24, Now York City# vas supplemented 
by a quality incentive grant from State Urban Education funds. 
These funds were used to establish a Corrective Reading Program 
and an English as a Second Language Program, The major objectives, 
findings and recommendations for the two programs are suii\marized 
below. 

CORRECTIVE READING PROGRAM 

Program Oblectives r The Stato Urban Education Corroctivo 
Reading Program had the following primary objectives i 

!• To provide corrective reading diagnostic and pre- 
scriptive services for each participant so that he will increase 
his competence in reading, 

2, To increase individualization of instruction for 
program participants through the sorvices of paraprofessionals as 
a means of increasing pupil growth in reading. 

Findings for Reading Achievement . The data presented in 
this report support the conclusion that the program was successful 
in achieving its objective to increase participants* reading 
achievement levels. The following findings support that conclusion, 

1. When actual post -test performance was compared to 
anticipated performance, more than 50 percent of the students at 
each grade level and of the total group made gains above expected 
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in word Knovltftdgei reading comprehension and total reading on 
the Metropolitan Achievement Test and the comprehension subtest 
of the Stanford Diagnostic Reading Teat # In fact, in total 
reading achievement # 69 percent achieved above expected* seven 
percent the same as expected and 24 percent belov expected « 

2. Grade level comparisons shoved that the gains made 
above those anticipated in word knowledge i comprehension and total 
reading on the Metropolitan Achievement Test were statistically 
significant for all grade levels* except the second grade where 
students* achieviment. in comprehension was greater than expected 
but not significantly greater. The same comparison for scores on 
the Stanford Diagnostic Reading Test indicated that students in 
all grades except the second and sixth made gains significantly 
above those expected in reading comprehension based on their 
previous rate of growth # The lower gains among second and sixth 
graders may be accounted for by the relatively small number of 
students in the evaluation samples* The second and sixth grade 
students in the evaluation samples did make average gains that 
were higher than expected but these gains were not significantly 
higher than expected. 

3» Comparisons of the gains of the more severely and 
less severely retarded readers revealed that more than 50 percent * 
and often 60 to 70 percent j of the students in each group made 
gains above expected in all areas of reading measured » A greater 
percentage, however* of the more severely retarded readers than 
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of the less severely retarded readers achieved above expected gains 
in word knowledge^ comprehension and total reading as measured by 
the Metropolitan Achievement Test and the Stanford Diagnostic 
Reading Tegt# 

4. Although both the more severely and the less severely 
retarded readers made reading achievement gains significantly above 
those anticipated for them# there was evidence that the more 
severely retarded readers made greater gains than the less 
severely retarded readers t These findings suggest that the 
program was more successful with students who were more severely 
retarded in reading at the beginning of the program. Similar 
findings were reported in the 1971-1972 evaluation and suggest again 
that the amount of improvement in reaOing is directly related to 
the amount of instruction provided, 

Findings for Specific Reading Skills , The data presented 
in this report support the conclusion that the program was 
successful in increasing participants* performance in specific 
reading skills. The following finding supports that conclusion. 

When pre-test and post^test scores on the appropriate 
level of the Stanford Diagnostic Reading Test were compared i gains 
in all skill areas were significant. Younger students in the 
program made gains that were generally more significant than gains 
made by older students in the program. 
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Findings for Reading Attitude . The third obiectlvo of 
the Corrective Reading Program was to improve program part icipiu\t ,q' 
attitude toward reading* Pre-program and post-program scores on 
the Reading Attitude Index were used to assess progress toward 
this objective* 

The data presented in this report support the conclusion 
that the program was not successful in improving program parti- 
cipants' attitude toward reading* The following finding supports 
that conclusion* 

When pre-program and post-program scores on the Reading 
Attitude Index were compared # attitude toward reading was no more 
positive at the end of the program than it was at the beginning 
for students at any grade level. Students in the sixth grade 
became significantly less positive in their attitude toward reading 
during the year* 

Findings for Impact of Paraprofessionals . The data 
presented in this report support the conclusion that the addition 
of paraprof essional services did not significantly increase pupils* 
growth in reading achievement and, therefore, the program objective 
was not achieved* Students in the State Urban Education Program 
did show improvement in their attitudes toward reading, however « 
The following findings support the conclusions stated above. 
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1 , When pre-test and poet-test scores of students in the 
State Urban education Corrective Reading Program were compared 

to pre^^test and post-test scores for students in the tax levy 
corrective reading program* no significant differences were found 
in total reading achievement as measured by the Metropolitan 
Achievement Test t 

2. When pre-test and post-test scores of students in the 
State Urban Education Corrective Reading Program were compared 

to pre-te^t and post-test scores for students in the tax levy 
corrective reading program, significant differences were found in 
reading comprehension skills as measured by the Stanford Diagnosti c 
Reading Test which favored the tax levy students. 

3» Attitude toward reading scorer, of the State Urban 
Education Corrective Reading Program participants on the Reading 
Attitude Index were significantly more positive than those of 
students in the tax levy corrective reading program. It is 
difficult to attribute the changes in attitude toward reading to 
the addition of paraprofessional services since the role of the 
paraprofessional is not clearly evident in teachers* reports of 
paraprof essionals* duties. 

Recommendations . The evidence presented in this report 
points to the general success of the Corrective Reading Program , 
in affecting significant student progress in basic reading skills 
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and total reading achievement, Thusi the following reccMnmendations 
are offered as guidelines for further improving and refining the 
program now in operation. 

!• There were nearly one-third of the program participants 
who were achieving less than their expected rate of growth. 
This may be due to weaknesses in diagnostic procedures and the 
prescriptive instruction used for these children. Every effort 
should be made to determine the causes for tho low achievement of 
this groups as a means of improving the reading instruction for 
all children. 

2. Since the program has been successful in improving 
basic reading skills among a large proportion of the population, 
efforts should now be made to move these r ,udents toward increased 
reading comprehension and higher level critical reading skills. 
Programmatic efforts could include increased use of a variety of 
high interest materials and improved teaching skill for the d vc:.op- 
ment of interpretiv*i inferential, analytical and evaluative 
reading skills. The intent of such efforts woulrl be not only 

to increase students* r<»ading proficiency but their enjoyment of 
reading as well. There was evidence that this important corollary 
objective was not achieved in the current program. 

3. The district staff should seriously weigh the gains 
to be derived from inclusion of second graders in the Corrective 
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Reading Progran\. On tho basis of the selection instruments and 
criteria used in the program, it is highly inappropriate to 
include second graders. It is rocomrended that the program be 
limited to students in grades 3 through 9. If early identification 
of reading or other learning disabilities becomes a goal for 
District 24, careful study will need to be made of the concomitant 
implications for screening, selection, program and evaluation 
procedures. 

4. There vas again evidence that the amount of improvement 
in reading achievement vas related to tlie amount of instruction 
received. Therefore, the staff should continue to accurately 
assign the more severely retarded readers to the instructional 
groups that meet more frequently. 

5. There was evidence that the level of professional 
preparation among the reading teachers was higher than the pre~ 
ceding year. This is a desirable trend and the dintrict should 
make every effort to continue to recruit qualified spcjcia lists 
for the program. However, the number of students who are still 
not achieving alx)ve their previous rate of growth and the need 
to expand the achievement of those who are making gains above 
expected to include higher level reading skills do point to the 
need for continued inservice training that emphasizos the goals 
of this program. 
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6* If the objective to provide paraprof e«sional sorviro« 
as a moanf] of increasinq student achievement in readinq is to bo 
continued! chanqos must be made in the role presently assumed 
by paraprof essionals. The paraprofessionals* role should be 
defined as primarily instructional! they should receive adequate 
traininct for the role^ and the reading teachers should be 
adequately prepared to effectively use the paraprof essionals in 
the instructional program^ If paraprofessionals are not used 
in instructional roles > then this aspect of the program should 
be reassessed. 

7. Provision must be made for adequate time for readinq 
teachers to confer with parents and classroom teachers who should 
play a significant cooperative role in the resolution of reading 
problems • 

8» The district staff should continue in the direction 
of providing adeguate diagnostic and prescriptive instruction 
in the developmental reading program t so that the separate 
Corrective Reading Program can be phased out. This will permit 
the reading specialists in each school to become reading resource 
teachers and teacher trainers who can offer classroom teachers 
specialized assistance in developing their reading programs, 

ENGLISH AS A SECOND LANGUAGE PROGRAM 

Program Objectives ^ The primary objective of the State 
Urban English as a Second Language (BSL) Program was to increase 
the ability of non-native speaking pupils to understand and speak 
English. 
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A corollary objective of tho proqram waB to movo 
ESL students toward the acquiBltion of readlnq and writinq 
skills in English as readiness is attained. 

Findings for Program Qperation t The evaluation of the 
program operation revealed the following findings, 

1. Major changes in the planned program design were 
made at each school. These changes did result in more students 
being serviced by the program than originally planned, but the 
changes also resulted in a concomitant roiuction in the average 

• amount of instruction in English rec<?ived by students in the 
program. 

2. The high mobility oi- the non-English speaking 
student population brought rome instability to the instructional 
program and further reciuced the amount of instruction students 
received. A numbev of students were transferred to the main- 
stream program Uf>fore their language facility was adequate for 
academic success in a regular classroom program. 

A wide range of ESL teacher competence was observed. 
In gon^ral, ESL teachers were skilled in a narrow range of 
teaching behaviors related to second language learning. 
Findings for Students* Receptive and Productive 
Competence . The evaluation of program effectiveness resulted 
In the following findings. 
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!• For the total ESL sample, regardless of grade 
level t students in the program shoved significant pre- to 
post-program gains in all receptive* and productive English 
language skill areas* 

2. A consistent age relatt»d pattern of language 
learning emerged from the data. Children in grades kindergarten 
through grade three showed the greatest growth in English 
proficioncy, students in grades four through six demonstrated 
somewhat less growth, while students in grades seven to nine 
demonstrated the least amount of growth in English proficiency, 

While the data did show that students in the ESL 
program made significant gains in their ability to understand 
and speak English, no conclusive statement can be made about 
the program's effectiveness since no comparison group was 
available. It is difficult to conclude, therefore, that the 
gains made by the students in the ESL program were greater 
than those that might have been expected from students in a 
regular program with no specialized instruction in English. 
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Reconynendationa ♦ Based on the findings of thi.s 
evaluation of the ESL Program* the following recommendations 
are made* 

1. An effort must be made to structure the ESL Program 
so that students will receive consistent and adequate amounts of 
instruction in the use of English commensurate with their level 
of language proficiency. 

2. A study should be made of the extent and nature of 
the population mobility in each school in order to design a 
program that would p^'ovide stable instruction for larger 
numbers of students. Provisions must be made to offer new 
arrivals needed instruction in E&glish without transferring 
students to the mainstream before they are proficient enough in 
English to succeed academically. 

3. There is a need to recruit teachers for the program 
who have been adeqvately trained in ESL techniques or to expand 
the Inservice training in order to improve the present ESL 
teachers' effectiveness. 

4. While oral fluency in Encfllsh is essential as a valid 
objective, the ESL Program should be expanded to include the 
tool subjects of reading and writing in Bn^liah if students are 
to successfully achieve in the regular school curriculum. 
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5, Because of tho subjective nature of teacher ratinqs, 
it Is fiuqqested that whenever possible more objective measurofii 
such afii the Linguistic Capacity Index > also be used. Multiple 
measures provide more accurate information for pupil seiectioni 
for diagnosis of children's language strengths and veaknessesi 
and for assessment of pupil achievement in learning English as a 
second language. 

6, Analysis of pre- and post-program scores showed that 
the youngest children in the program (grades kindergarten to 3) 
made the greatest gains. Although the greater language learning 
facility generally found among younger children may account for 
this finding^ other factors such as differences in instructional 
approach* program structure and teacher effectiveness may have 
been operating. These and other factors should be examined in 
order to determine how the effectiveness of the program might be 
increased in the upper grades. 
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INTRODUCTION 



During the 1972-73 scaiool year, the regular 

educational programs in District 24 New York City wore 

supplemented with educational services supported by a 

Quality Incentive Grant imder the New York state Urban 

Education Program. This report includes evaluations of 

programs funded under the following headings! 

I. Diagnosis and Treatment of Reading 

Disabilities Program (Corrective (79-36452) 
Reading) 

II* English as a Second Language (79-36453) 
Program 
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CORRECTIVE READING PROGRAM 



PROGRAM OBJECriVES 

The Jitat© Urban Education Coi'tectlve Reading Program 
had the following as primary objectives i 

1, To provide corrective reading diagnostic and 
prescriptive servictss for each participant so that he will 
increase his competence in reading. 

2. To increase individualization of instruction for 
program participants through the services of paraprofeoslonals 
as a means of Increasing pu'pll growth in reading* 

EVALUATION OBJECTIVES 

To assess program ef fectivenessy the following evaluation 
objectives were delineated i 

1. Given pre and post«*test scores^ program participants 
will manifest significant improvement in (a) total reading achieve- 
vxentp (b) specific reading skills^ and (c) attitude toward reading. 

2. Given pre- and post -program scores* children In the 
Corrective Reading Program will manifest significantly better 
improvement in reading achievement and attitude toward reading 
when compared to studenta in a parallel program which does not 
use paraprofessionals* 
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I 



METHODS OF DATA COLLECTION 

In order to assess the effectiveness of the program in 
achieving the stated object ivest the folloving methods were usedt 
Questionnaires eliciting the background preparation of the Corrective 
Reading Teachers^ their assesstnent of the inservice training 
provided f and their assessment of the effectiveness of the program 
(see Appendix A) were administered. In addition! the opinions 
of the principals^ the program coordinator! and classroom teachers 
with students in the Corrective Reading Program were elicited 
through questionnaires (Appendices B^C, and D>, 

Three measures were used to assess pupil growth In 
reading* Scores on the Metropolitan Achievement Test were used 
as the measure of pupils* level of reading achievement. Growth 
in specific reading skills was assessed by scores on the subtests 
of the Stanford Diagnostic Readin g Test > and pupils* attitude 
toward reading was measured by the Index of Reading Attitude 
(Appendix E)« The three measures were administered on a pre and 
post test basis. 

DESCRIPTION OF PROGRAM IN OPERATION 

Program Implementation . During the 1972-1973 school year. 
District 24 established diagnostic and prescriptive reading 
centers to service remedial readers in 11 schools^ seven elementary, 
one intermediate and three Junior high schools. Table 1 shows the 
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schools* the number of teachers and the number of students in 
the Corrective Reading Program. 

TABLE 1 

LOCATION OF STATE URBAN CORRECTIVE READING CENTERS 
AND NUMBER OF PUPILS SERVICED 

Number of Number of 



School 


Teachers 


Students 


P.S. 


13 


1 


55 


P.S. 


14 


1 


55 


P.S. 


19 


2 


110 


P.S. 


68 


1 


55 


P.S. 


81 


1 


95 


P.S. 


143 


2 


110 


P.S. 


199 


1 


55 


I.S. 


61 


3 


165 


J.H. 


73 


2 


110 


J.H. 


93 


2 


110 


J.H. 


125 


2 


110 






18 


990 



Subtotals 

Elementary 9 495 

Intermediate 3 165 

Junior High _6_ 332 

18 990 
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As Table 1 0howa# a total of 990 pupils received 
corrective reading Inetructiont Of these# 495 were elementary 
school childreni 165 were intermediate school children and 
330 were Junior high school students • 

Program Organization . This was the second year of 
operation for the Corrective Reading Program# the basic structure 
of which was carefully planned and successfully tested during the 

1971- 72 school year. Based on the evaluation of the first yearns 
program » some modifications were made in the organization of the 

1972- 73 program. These modifications brought about a needed 
reduction in the Corrective Reading Teachers* workload. 

This year I the design for the State Urban Education 
program called for each reading teacher to service five instruc- 
tional groups of approximately 11 students eachi a total of 55 
pupils per teacher. From the target population at each elementary 
school* 33 students who were two or more years retarded in reading 
and 22 students who were less than two years but not less than 
one year retarded in reading were selected for the program. 
The 33 more seriously retarded readers were divided into three 
groups* each of which met three times a week. Two of these groups 
met for one and a half hour sessions or a total of four and a 
half hours of instruction a week. The third group of more severely 
retarded readers met for one hour and 15-minute sessions or a 
total of three hours and 45 minutes per week. The 22 students 
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vlth lass severe reading problems were divided Into two groups* 
each of which met two times a week for one and a half hours » a 
total of three hours of instruction weekly. 

Each intermediate and junior high school reading teacher 
met each of the five instructional groups on a dally basis. 
All pupils in the program at this level received 45 minutes of 
instruction per day* five days per veeki a total of three hours 
and 45 minutes per week. Efforts vere made to have three of the 
groups consist of more severely retarded readers # and the other 
two groups to consist of less severely retarded readers. 
Organizing instructional groups into more and less seriously 
retarded readers^ as the design specif ledi. vas more difficult to 
do at the secondary schools than at the elementary schools because 
of scheduling difficulties. 

In the schools not eligible for Title I service i three 
45 -minute periods a veek vere set aside for teachers to provide 
additional individualized instruction to program participants 
in need of special attention in skill development or reading in 
the content areas. In addition» teachers had two 4$-minute pre- 
paration periods a week for program related activities such as 
record keeping* lesson planning* preparation of materials* and 
conferences with parents* classroom teachers and paraprofesslonals. 
In schools eligible under Title I (P.S. 68* P.S, 81* P.s. 143 and 
I.S. 61)* teachers had all five 45-minute periods per week for 
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i 

program preparation in accord with the contract with the United 
Federation of Teachers! however t they could use theee periods to 
provide additional instruction to students who needed special 
at tent ion i 

Program Staff > The program was coordinated by the 
district's reading specialist for reimburseable programs. His 
responsibilities included conducting an initial orientation and 
the biweekly inservice training sessions* Based on last year's 
evaluation » the elementary and secondary staffs met on alternate 
weeks eo that the inservice training sessions could focus on the 
special needs and problems of the staff at each level* In 
addition t the program coordinator was responsible for the ongoing 
supervision of the program t 

!• Corrective Reading Teachers 

The 18 Corrective Reading Teachers represented a wide 
range of teaching experience and background preparation for the 
task. Of the 17 who responded to the Corrective Reading Teacher 
Questionnaire (Appendix A), all reported they had obtained the 
Bachelor's degree, two since 1970, six between 1960 and 1969, and 
nine before 1960. Twelve of the Corrective Reading Teachers have 
received a Master's degree, five of whom had reading as their 
major field. Two others reported they had 30 credits beyond the 
Bachelor's degree including courses in the teaching of reading. 
Another indicated she was presently enrolled in a Master's degree 
program in reading. 
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When asked to Indicate courses they had taken that were 
relevant to teaching corrective reading^ 12 teachers responded 
they had taken a course in Foundations of Reading Instruction, 
eight had taken courses In Diagnostic Reading Techniques^ Corrective 
Reading Instruction, and Reading in the Content Areas, and two had 
a course in Individualized Reading Instruction, Some teachers 
had also had a course in learning disabilities, reading for the 
disadvantaged or children* s literature^ 

These findings do indicate that the level of professional 
preparation among teachers in the State Urban Corrective Reading 
Program was higher this year than it was last year« However, 
there are still some teachers in the program who lack adequate 
background preparation for the program. 

The 17 teachers who responded also reported a range of 
experience in teaching corrective reading* The group as a whole 
reported from one to eight years of experience in teaching 
corrective reading in the public schools* Seven had done private 
tutorial work in reading f five had taught in after-school tutorial 
reading programs, and four had experience as parent«*volunteer 
reading tutors. 

In general, then, the corrective reading staff in this 
year's State urban Education Program appeared to have a higher 
level of professional preparation than last year's staff* Only 
six of the 18 teachers were new to the District 24 program this 



ERIC 



yeati Indicating that a majority of the teachore were familiar 
with the basic aime and operation of the Corrective Reading Program* 
2 • Pa raprofeasionals 

To provide further individualization of instruction to 
program participantsi one full time paraprofessional vas assigned 
to each elementary school Corrective Reading Teacher. Each 
paraprofessional was to participate in daily and long range 
planning! provide assistance with individual and small group 
instructioni assist with record keeping and preparation of materialsi 
and escort students to and from their classes. In additloni 
the paraprofessionals attended biweekly inservice training sessions 
and received on-the-job training during the year. 

Evaluation of Inservice Tjrainina , The inservice training 
program for the District 24 Corrective Reading Teachers was an 
attempt to raise the level of teacher effectiveness and thereby 
increase the possibilities for the success of the program* Bi-* 
weekly sessions conducted by the program coordinator focused on the 
program components of selection of students i diagnosis and 
remediation of reading problems* New materials were demonstrated 
and problems related to the program were discussed* The Corrective 
Reading Teachers at the elementary level and those at the junior 
high school level met with the program coordinator on alternate 
weeks so that the discussions could be more specifically directed 
toward concerns that were crucial to each group# 
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The Corrective Reading Teachers vere asked to evaluate 
the adequacy of the Information presented in the inservice 
training program on the Corrective Reading Teacher Questionnaire 
(see Appendix h) , sixteen of the 18 teachers responded. The 
rating scale used was' 1 "unsatisfactory) 2«barely satisfactory^ 
3»average» 4aabove average f and 5«very satisfactory* Items that 
vere not covered w«»ro assigned NC. The tabulation of the ratings 
appears in Table 2. 

TABLE 2 

CORRECTIVE READING TEACHERS' EVALUATION 
OP INSERVICE TRAINING PROGRAM 

(N«16) Frequency for 
Each Rating 



Topic 



NC* 



1 2 3 4 5 



Mean 
Rating 



Organization, administration & 
supsrvision of the program 


0 


0 


1 


4 


6 


5 


3.9 


Program objectives & rationale 


0 


0 


0 


1 


7 


8 


4.4 


Criteria for selection of 
participants 


0 


1 


0 


6 


2 


7 


3.9 


Procedures f6r selection of 
participants 




1 


1 


4 


3 


6 


3.8 


Specific procedures for diagnosis 




0 


0 


3 


6 


6 


4.2 


Knovledge of reading skills 




0 


1 


7 


5 


2 


3.5 


Methods of corrective instruction 




1 


4 


7 


2 


1 


2.9 


Use of instructional materials 




2 


1 


3 


5 


4 


3.5 


Selection & evaluation of materials 


2 


1 


1 


4 


5 


3 


3,6 


Organlasing class for Instruction 


2 


1 


2 


3 


5 


3 


3.5 


Techniques for evaluating progress 


0 


1 


1 


6 


2 


6 


3.7 


Record keeping policies & procedures 


0 


0 


0 


7 


4 


5 


3.9 


Techniques for using parapro- 
fesslonals (N«=9) 


1 


0 


0 


4 


3 


1 


3.6 


Techniques for parent involvement 


3 


1 


4 


6 


0 


2 


2.8 



♦Not covered 
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The frequencies and mean ratings shown in Table 2 indicate 
that the Corrective Reading Teachers foxmd the Information in 
the inservice training program related to program objectives^ 
rationale^ organii&atlon and pupil selection to be veil above 
average* Furthermore # it should be noted that no topic presented 
vas rated belov 2.8 (close to average). In comparison with the 
ratings of similar components of the inservice training program 
during 1971-72, this yearns assessment by the Corrective Reading 
Teachers is generally more positive. The area which elicited 
markedly incroased ratings was techniques for using parapro- 
fessionals (2«6 to 3«6). Corrective Reading l^eachers in the 
program demonstrated a positive level of satisfaction about the 
content of the inservice training program, although several 
unsolicited comments on the questionnaires showed some dis- 
agreement about the schedule of meetings. The complaint that 
meetings were too frequent when the time was needed in the class- 
room was made several times. The need for more demonstration 
teaching, more stress on learning disabilities and methods as 
well as examinatiori of materials for the classroom were requested. 
One teacher wanted to suggest topics for the agenda so that dis- 
cussions of concrete techniques and problems were included. The 
State urban Education Corrective Reading Teachers appeared to 
have high standards for the Inservice Instruction they wanted. 
The requests for specific: suggestions to improve their teaching 
were widespread. 
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The item ratings of the Inservlce training program were 
generally very positive and indicated the Corrective Reading 
Teachers believed they profited from it. 

The principals* Corrective Reading Teachers and the program 
coordinator were asked to evaluate the amount and the quality of 
this year's insorvice training program and to compare it with the 
previous year. A comparison of their responses can be seen in 
Table 3. 

TABLE 3 

COMPARISON OF TEAaiERS*, PRINCIPALS* AND COORDINATOR'S OVERALL 
EVALUATION OF INSERVICE TRAINING PROGRAM 



Item 



Corrective 
Ig. Tch] 
iN5l^ 



Program 

Rdg. Tchrs. Principals Coordinator 



(N«10) 



(N«l) 



Kas the amount of inservice 
training sufficient? 

NO 
YES 

NO RESPONSE 

On a 1 to 5 scale* give your 
overall rating for this year's 
inservice program 

MEAN RATING 

Did you (your teachers) par- 
ticipate in last year's 
inservice program? 

NO 
YES 

Compared to last year this 
year's training vasi 

INFERIOR 
ABOUT SAME 
SUPERIOR 



6 
9 
1 



3,5 



2 

8 
0 



0 
1 
0 



3.8 



6 
10 



2 
4 
4 



1 
9 



0 
3 
6 



4.0 



0 
1 



0 
0 

1 



ERIC 



-12- 



The responses seen in Table 3 show that the program 
coordinator and a majority of Corrective Reading Teachers and 
the principals iouxvi the amount of inservlce training to be 
sufficients These groups found the quality of the inservice 
training to be well above average. Only two teachers i among 
those participating the previous yeari found the inservice training 
to be infer ior» whereas four teachers and three principals thought 
it was about the same and four teachers and six principals thought 
it was superior to the prior year. 

The overall ratings of the inservice training program were 
generally positive and showed a sizeable Increase over the ratings 
of the previous year. Comments which were written on the question- 
naires suggested a need for more demonstration teaching by fellow 
teachers and the coordinatori more demonstrations of diagnostic 
techniques and specific skill remediation techniques! and more 
opportunities for new teachers to observe experienced teachers. 
It should be noted that six of the 16 Corrective Reading Teachers 
who re3ponde<^ were new to the program this year. The new teachers 
indicated they would benefit from additional guidance in the 
implementation of the program. 

Evaluation of Program Oraanigation# Facilities and Materials . 
The organization of the Corrective Reading Program and the facilities 
and materials used in its operation were evaluated by 17 Corrective 
Reading Teachers ^ ten principalsi the program coordinator and 63 
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classroom teachers who had students in the program. The same 1 
to 5 rating scale* used throughout all questionnaires* was used 
to indicate the level of satisfaction for each topic the rating 
group evaluated. When a group was not asked to rate a specific 
item* a slash mark is inserted in the tables. The mean ratings 
for program organization* facilities and materials appear in 
Table 4, 

TABLE 4 

MEAN RATINGS FOR PROGRAM ORGANIZATION, 
PHYSICAL FACILITIES AND MATERIALS 

Reading Program Classroom 
Item Teachers Principals Coordinator Teachers 
(Nal7) (NalO) (Nap (N«63) 

Program Organization 

Organization (scheduling* 

number of classes* etc.) 4.2 3,9 5,0 3.5 
Amount of time allocated 

for reading instruction 4.1 4.0 5,0 3.6 
Number of pupils' in 

each group 3.9 3.7 4.0 — 

OVERALL RATING 4.2 4.2 5,0 3.6 
Physical Facilities and Materials 
Size of room(s) for 

corrective rdg, instr, 2,8 2.8 3.0 
Physical facilities 

in room 2,8 2.8 3,0 

Types of instruct, 
materials provided 

for program 4,0 4.4 5,0 — 

Quantity of materials 

provided 4.0 4,2 5.0 

Availability of 
materials at start of 

program 2,9 4.0 4.0 

OVERALL RATING 3.4 4.0 4.0 
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The mean ratings shown in Table 4 show that the general 
level of satisfaction with the Corrective Reading Program 
organization is veil above average* The item receiving the lowest 
rating from the Corrective Reading Teachers^ number of pupils 
in each groupt averaged 3,9 (above average). The 3.9 rating is 
well above the 2.0 rating given this item in the 1971-72 evaluation* 
The programmatic change from servicing 78 pupils per teacher to 
servicing 55 pupils per teacher undoubtedly accounts for the 
increased ratings. Several Corrective Reading Teabhers commented 
that this yearns ratio produced a desirable size for the groups. 

The classroom teachers g»ve the lowest ratings in the 
assessment of program organizationi although they were well above 
average. Some classroom teachers remarked that the scheduling 
of students disrupted their classrooms and that missing one and 
a half hours of regular classroom work was difficult for students 
who were remedial readers. The general tone of comments volunteered 
by each rating group was positlve# however # and the ratings con- 
firm the favorable attitude toward the Corrective Reading Program 
organization. 

The ratings of physical facilities and materials range 
from 2.8 to 5.0. The Corrective Reading Teachers themselves do 
not regard their facilities and materials as favorably as others 
related to the program regard them. The comparison of current 



rather than the one previously used in the program* was an 
attempt to arrive at a mora realistic assessment of students 
needing remediation. The single achievement score used in pre- 
vious years tended to inflate actual performance or show the 
frustration level at vhich a utudent could work rather than his 
instructional level. 

The Corrective Reading Teachers* principals* program 
coordinator and classroom teachers were asked to rate the pro- 
cedures used for pupil selection* diagnosis and evaluation. The 
summary of their ratings appear in Table 5, The slash marks show 
that a particular group was not asked to rate that item. 

TABLE 5 

MEAN RATINGS FOR PUPIL SELECTION, DIAGNOSIS 
AND EVALUATION PROCEDURES 

Reading Program Classroom 

Teachers Principals Coordln. Teachers 
Item (N«»17) (N«10) (N«l) (N»63) 

Pupil Selection 

Criteria used to select 

pupils 2.8 3,3 4.0 2.7 
Procedures used to 

select pupils 3.4 3.9 4.0 3.0 

Assignment to groups 
on basis of severity 

of reading retardation 3.3 3.5 4.0 

Number of students 
serviced compared to 
number who need 

corrective reading 2.2 2.2 4,0 2.7 

OVERALL RATING 3.2 3.6 4.0 2.9 
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Reading Program Classroom 

Teachers Principals Coordin. Teachore 

Diaanoaia and Evaluat.ion 
Use of Informal Reading 

Inventory 3.9 — 4.0 «— 



use of MetroDOlltan 
Readina Teat 


3.1 


3.1 


3.0 


Use of Stanford 
Dlaanosti9 Readina 


3.9 


4.0 


4,0 


Materials provided for 
diagnosis and evaluation 


3.5 


4.0 


4.0 


Record keeping system 


3.5 


4.1 


5.0 


OVERALL RATING 


3.6 


3.8 


4.0 



The ratings for pupil selection procedures shown In 
Table 5 vary from 2.2 to 4»0i The Corrective Reading Teachers 
and the classroom teachers are least satisfied vlth aspects of 
selection* Comments by Corrective Reading Teachers Indicate that 

4 

they would like the screening procedures to be even more thorough* 
Vision and hearing tests were suggested as needed additions* 

The selection criterion related to poverty was criticized 
by some Corrective Reading Teachers. They point out that even 
children of average financial circumstances need reading assistance* 
The requirement to test all children at the beginning of the year 
to see if they qualify in educational need as well as in financial 
need is a burdensome tasH* The plan of assigning students to 
groups according to level of retardation appears to be satisfactory 
to the associated staff* 
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One issue that obviously plagues Corrective Reading Teachers* 
principals and classroom teachers is the numbers of children who 
receive specialized instruction in reading in relation to the 
number vho need it* llie 2.2 and 2.7 ratings shov that few are 
satisfied with the availability of specialized instruction. 
It is clear that more students need the additional help than 
receive it but attempts to resolve this problem will probably 
create other problems. Some of the funded programs have attempted 
to service all cdiildren viio need the help without increasing 
the size of the professional staff. Thus* more children are 
serviced but all then receive less individualized help. The 
result associated with the distribution of limited services is 
that all children achieve less. The only reasonable way to extend 
corrective reading services is to increase the number of corrective 
reading teacdiers. Maintaining a high qaality and thorouoh corrective 
reading program must be weighed against broader distribution of 
services. 

The overall ratings of the pupil selection procedures 
ranged f rom HLightly below average (2,9) by the classroom teachers 
to above average (4.0) by the program coordinator. The issues 
Involved in the disparate ratings perhaps cannot be resolved but 
at least should be understood by staff associated with the program. 
The same disparity existed in the 1971-72 program evaluation and 
perhaps suggests open discussion of the issues involved. 
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Tho evaluation of the diagtiosie and evaluation procedures 
resulted in above average ratings for every aspect assessed # The 
combined use of the Metropolitan Achievement Teat and the Stanford 
Diagnostic Reading Test has increased the ovsrall level of 
satisfaction vith diagnosiu and evaluation procedures from the 
1971-72 evaluation report. The continued recognition of the need 
to use the Informal Reading Inventory is supported by the 3.9 
and 4.0 mean ratings of Corrective Reading Teachers and the program 
coordinator. 

The Corrective Reading Teachers indicate that they want 
more materials for diagnosis and evaluation vhlch is in accord 
vith their assessment of mterials in the preceding section. 
The record keeping system was rated lowest by Corrective Reading 
Teachers (3.5) and highest by the program coordinator (5.0). 
The revisions made in the procedures for keeping the dally logs 
apparently have increased the level of satisfaction since the 
1971-72 evaluation. The 2.8» 3.0 and 4.0 ratings of the record 
keeping system In effect during 1971-72 has changed to 3.5, 4.1 
and 5.0 for the current record keeping system. One teacher 
commented that further Improvement in record keeping is needed 
and suggested uniformity and reduction of repetition. All 
suggestions were constructive* and reflected a desire to perfect 
the program* 
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Tho overall ratings of pupil diagnosis and evaluation are 
veil above average* The revisions made in the present Corrective 
Reading Program have noticeably increased the level of satisfaction 
of the staff associated with the program. 

Evaluation of Student and Parent Attitudes Toward the 
Program , The objective to Improve students • attitude toward 
the Corrective Reading Program was assessed directly from atudent 
data# however > the Corrective Reading Teachers, principalsi program 
coordinator and the classroom teachers also were asked to judge 
students* attitude and progress as well as parents* attitude 
toward the program. The summary of their ratings appears in 
Table 6t A slash mark indicates that the group was not asked to 
respond to that item. 

TABLE 6 

MEAN RATINGS FOR STUDENT AND PARENT 
ATTITUDES TOWARD PROGRAM 

Reading Program Classroom 
Teachers Principals Coord. Teachers 
Item (Nel?) (NalO) (N=:l) (N»63) 

Students 

Students* attitudes toward 

corrective reading classes 4.2 3.9 4.0 3,7 

Observable improvement 
in pupil performance 

Parents 

Extent of parent involve- 
ment in the program 

Parents* attitude toward 
program 

Time for teachers to 
confer with parents 



4.0 


3.9 


4.0 


3.2 


2.4 


2.3 


4,0 




3.4 


3.6 


4,0 


3.7 


2.9 


3.3 


4.0 





ERIC 



-21 



The mean ratings in Table 6 show a positive level of 
aatiaf action from the Corrective Reading Teachers » principals^ pro- 
gram coordinator and classroom teacSiers about students' and 
parents' attitude toward the program* The ratings range near 
the 4,0 level Indicating that the associated staff believes that 
the program is vieved above average by students and their parents. 
Voluntary comments made by several classroom teachers verify the 
positive nature of students* attitude. Comments such as* "My 
students like their Corrective Reading Teacher very much and are 
anxious to go to her room," and "The students in the program 
have shown a great increase in their desire to read*" are 
indicative of the teachers' assessment of student attitude. 

The staff assessment of the observable improvement in 
pupil performance is nearly as favorlible as their assessment of 
attitudes toward the program. The Corrective Reading Teachers' 
and the classroom teachers' ratings were lower than the other 
raters. Many comments by the classroom teachers indicated that 
their students had made very good progress in reading this year 
although one questioned attributing the Improvement entirely to 
the Corrective Reading Program, 

The items rated lowest in the staff evaluation of parents* 
attitude and involvement dealt with the extent of parental 
involvement in the program. Both Corrective Reading Teachers and 
principals believe that parents' involvement is no more thar 
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barely 3a(;l8fac±ory. Both groups believe that parents' attitude 
toward the program is somewhat aborve average and that time for 
parent conferences is about average but it appearo chey are not 
satisfied with the extent to which parents actually do become 
involved in the program. 

The staff's ratings of students* attitude is higher than 
their ratings of parents' attitude toward the Corrective Reading 
Program. The principa3.s were least positive about the extent of 
parent involvement. Suggestions about orientation meetings for 
parents were made by several people. 

Evaluatlor^ of Personnel Suptx)rt . The Corrective Reading 
Teachers* principals* program coordinator and classroom teachers 
evaluated the level of cooperation, communication and interaction 
among school personnel in relation to the Corrective Reading 
Program. The State Urban Education Corrective Reading Program 
included the use of paraprofesslonal services at the elementary 
school level, therefore, an evaluation of the quality of those 
services is incorporated here. 

The summary of the ratings nade of the personnel support 
by the associated staff appears in Table 7. Slash marks show that 
the item was not rated by that group. 
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TABLE 7 

MEAN RATINGS FOR PERSONNEL SUPPORT 

Reading Program Classroom 
Tdachera Principals Coord. Teachers 
USB <N«17) (M-ljO) (N«l) (N«63)._ 

Cooperation of school 

personnel generally 3.9 4.1 4.0 -»•> 

Coiranunication between 
reading teacher and 

classroom teatiher 3.6 3.7 4.0 3.4 

Adoption of corrective 
reading techniques by 

classroom teachers 3.2 3.5 5.0 3,1 

Time for corrective 
reading teacheri3 to 
confer with classroom 

teachers 2.7 2,9 4,0 2,5 

Classroom teachers* 
attitude toward 

program 3.5 3.6 4.0 

Paraprof essionals ' 

preparation and skill 3.5 — — — 

(Nt»9) 

Quail ity of services 
provided by para pro- 
fessionals 4.1 4.2 4.0 • 

(N»9) 

Teachers' ability to 
use paraprofessionals 

effectively — - 4.0 4.0 

Reading teachers* pre- 
paration and skills for 

program — - 4.0 4.0 — 

Quality of instruction 
provided by the Corrective 

Reading Teacher — 4.0 4.0 — 

Ongoing supervision by 

coordinator 3.9 3.9 — — 
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Th© ratings shown in Table 7 indicate a generally high 
level of satisfaction among the staff related to the Corrective 
Reading Program. The Corrective Reading Teachers, the principals i 
and the program coordinator believe that the cooperation from 
school personnel is well above average. A slight variation occurs 
in the ratings of oommunication between the Corrective Reading 
Teachers and the classroom teachers where the ratings drop from 
aroxmd 4,0 to 3.4 and 3.6. An explanation for this decrease in 
clearly evident in the ratings of another item— time for Corrective 
Reading Teachers to confer with classroom teachers. The ratings 
of 2 .71 2.9 and 2.5 assigned to this item by Corrective Reading 
TeacherSf principals and classroon teachers^ respectivelyi show 
that very few people are satief&Ad with this aspect of the program. 
Clearly I more staff conference time is desired. 

The ratings of the quality of paraprofessionalo* services, 
the interaction between the Corrective Reading Teachers and para- 
professionals, and the level of preparation of paraprofessionals 
are very positive, Obviously, all groups view the oontribution 
of the paraprofessionals to be a valid and worthy aspect of the 
program. 

A description of the responsibilities assumed by the 
paraprofessionals was requested of the Corrective Reading Teachers. 
The tally of the responsibilities showed that many things para- 
professionals do are not involved with instruction of children. 
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Organizlng materials* distributing and duplicating materials » 
correcting papers* escorting children and record keeping appear to 
consume a sizeable portion of the paraprofessional's day. Less 
than half of the duties listed vere directly instructional. 
The roles fulfilled by the paraprofesslonals do not seem to 
adequately reflect the goal stated for using their services » nor 
do they reflect the role description In the program proposal which 
Indicates that paraprofesslonals would play a significant role in 
instruction. The proposal stated that paraprofesslonals would 
assist in the prescriptive aspects of the program by having them 
work directly with individuals or small groups luider the super- 
vision of the Corrective Reading Teachers. The additional roles 
described in the program plan appear to have beco?se the primary 
roles fulfilled by most paraprofesslonals. 

The ratings of the quality of Instruction provided by 
the Corrective Reading Teachers and the ongoing supervision 
provided by the program coordinator were rated well above average. 
The level of satisfnction toward the central staff of the Corrective 
Reading Program appears to be high* 

Summary Evalxxation of the Corrective Reading Program . The 
Corrective Reading Teachers (CRT) > principals » the program co- 
ordinator and the classroom teachers were asked to compare the 
3.972-73 program with the 1971-72 program. The majority of the 
staff involved the preceding year (11 CRT's, ten principals, one 
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coordinator! 33 classroom teachers) believed the current program 
Is superior. When asked If they would be Interested In partici- 
pating next year in a similar program^ all 17 Corrective Reading 
Teachersi all principals, and 60 of 63 classroom teachers said 
yes* It is evident that the District 24 staff is committed to 
the Corrective Reading Program they have designed and implemented. 
Support for continued refinement and development is clearly 
evident in their ratings of their satisfaction with the program. 

EFFECTS OF PROGRAM ON CHIIDREN 

This section includes a discussion of the effects of 
the program on pupil growth in reading and is organized into four 
sections I growth in reading achievement, growth in specific 
reading skills, improvement in reading attitude, and the impact 
of paraprofessional services. 

Growth in Reading Achievement * The first objective of 
the Corrective Reading Program was to improve participants' 
level of reading achievement beyond that which would be expected 
from the regular classroom program. 

To assess the extent to which this objective was achieved, 
children* s scores on the Metropolitan Achievement Test were 
analyzed using their historical rate of growth as a control against 
which to compare the effects of the Corrective Reading Program. 
In this procedure, a pupil becomes his own control in that h4s 
historical rate of growth, which is calculated from his previous 
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performancQ record # is used to predict his expected level of 
performance if he had received no special instruction. The 
procedure for determining his rate of growth up to the onset of 
the special program is to subtract l^O from his pre-program 
achievement score and divide the remainder by the number of months 
the child has been in schooli including the number of years he 
was retained • For examplei if a fifth grade student scores 4«0 
in September » then based on his 40 months of previous schooling » 
his historical growth rate would be 3,0 divided by 40 or ,015 
per month I or #75 per school year. By using the historical rate 
of growthi the child *s achievement level at the end of fifth 
grade can be predictedi l,e«» he should be reading at 4.75 
according to her previous performance* lt$ in fact# his anticipated 
level of performance is exceeded by hie ^^ctual performance^ then 
it can be claimed with some assurance that the gain beyond that 
anticipated was due to the effects of the special instructional 
program. This procedure was used to determine whether the 
Corrective Reading Program in District 24 had a significant effect 
on participants* reading achievement levels. 

Scores from the April » 1972 administration of the Metropolitan 
Achievement Test were obtained from school records as the pre - 
program measure and were used as the basi«i for anticipating 
students* post-test performance the following Aprili 1973# when 
the test was again administered on a district-^wide basis. Complete 
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pre- and post-test data for the Metropolitan Achievement Test were 
available for 713 students or approximately 72 percent of all 
participants in the State Urban Education Corrective Reading Program, 
The size of the evaluation sample is sufficiently large to permit 
generalizations about the effectiveness of the program. 

A second measure of reading achievement was provided by 
the comprehension subtest of the Stanford Diagnostic R eading Test. 
The pre- and post-test grade level scores for achievement in 
comprehension also were analyzed using the historical rate of 
growth method. Most students* pre-program scores were available 
in school records from the May, 1972 administration of the test. 
New students in the program were administered the Stanford Di agnostic 
Reading Test in October as a pre-test measure. Adjustments were 
made accordingly in calculating the students* post-test performances 
anticipated for May, 1973 when the test was again administort^d on a 
district -wide basis. Complete pre- and post -test data on tViis 
measure were available for 771 students or approximately 78 percent 
of the program population. 

1 . Total Group and Grade Level Results 
Using the historical rate of growth method, anticipated 
post-test scores for the Metropolitan Reading Test were calculated 
for students in the Corrective Reading Program. The number and 
percentage of students at each grade level and in the total group 
who obtained actual post-test scores below, the same as, or above 



ERLC 



29 



anticipated in word knowledge, reading comprehension and total 
reading were coMj^ared* The results are presented in Table 8. 

TABLE 8 

NUMBER AND PERCENTAGE OF PUPILS MAKING GAINS BELOW, 
THE SAME AS, AND ABOVE ANTICIPATED ON THE 
METRpPOLITAN ACHIEVEMENT TEST 



WORD KNOWLEDGE COMPREHENSION TOTAL READING 

Grade N Below Same Above Below Same Above Below Same Above 



2 


5 


1 


0 


4 


0 


0 


5 


0 


0 


5 






(20) 


(0) 


(80) 


( 0) 


(0) 


(100) 


( 0) 


( 0) 


(100) 


3 


134 


30 


9 


95 


44 


6 


84 


39 


8 


87 






(22) 


(7) 


(71) 


(34) 


(4) 


( 62) 


(29( 


( 6) 


(65) 


4 


137 


40 


9 


88 


49 


7 


81 


42 


11 


84 






(29) 


(7) 


(64) 


(36) 


(5) 


( 59) 


(31) 


( 8) 


(61) 


5 


104 


30 


1 


73 


24 


4 


76 


14 


6 


84 






(29) 


(1) 


(70) 


(23) 


(4) 


( 73) 


(13) 


( 6) 


(81) 


6 


15 


2 


0 


13 


3 


1 


11 


2 


0 


13 






(13) 


(0) 


(87) 


(20) 


(7) 


( 73) 


(13) 


( 0) 


(87) 


7 


90 


19 


2 


69 


28 


1 


61 


19 


10 


61 






(21) 


(2) 


(77) 


(31) 


(1) 


( 68) 


(21) 


(U) 


(68) 


8 


164 


44 


6 


114 


55 


3 


106 


42 


6 


116 






(27) 


(4) 


(69) 


(33) 


(2) 


( 65) 


(25) 


( 4) 


(71) 


9 


64 


17 


1 


46 


20 


2 


42 


14 


9 


41 






(26) 


(2) 


(72) 


(31) 


(3) 


( 66) 


(22) 


(14) 


(64) 


Total 


713 


183 


28 


502 


223 


24 


466 


172 


50 


491 


Percent 




(26) 


(4) 


(70) 


(31) 


(3) 


(66) 


(24) 


( 7) 


(69) 



Table 8 IncludeB results for a small group of second graders for 
whom data were available. Although the program proposal called for 
children only in grades 3 through 9 to be selected for the program^ 
one group of second graders was included on a trial basis in one 
school in the hope that children identified as exhibiting reading 
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difflcultlea this early could be helped beifore their difficulties 
became serious* The second grade sanple Is too small to allow 
generalizations about the effectiveness of the program at this 
level I but the data are Included since their performance figures 
in the total group results and since the results may reveal 
trends for children at this grade level* 

As the data in Table 8 8hov# more than 50 percent of the 
children at each grade level and in the total group made gains 
above anticipated for them in vord knowledge and reading compre-* 
h^nsloni two of the subtests on the Mfttropolitan Achievement Test , 
With the exception of the second and fifth graders^ more children 
at each grade level achieved actual post-^test scores higher than 
their anticipated scores in word knowledge than in reading compre- 
hension* These results suggest that the instructional program 
was somewhat more effective at increasing students' reading word 
knowledge than at developing their skills in reading comprehension. 
In total reading achievement # which is ba^ed on a composite score 
from the word knowledge and reading comprehension subtests # Table 
8 shows that more than 60 percent of the children at each grade 
level and in the total group made gains above those expected 
based on their previous rate of growth in reading. 

In svmunaryi the data in Table 8 indicate that a substantial 
majority of the children in the State Urban Education Corrective 
Reading Program mide gains above those expected from their previous 
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rate of grovth» including 70 percent in word knovledqe* 66 percent 
in reading coroprehenflion» and 69 percent in total reading 
achievement I 

Tables 9, 10$ and 11 present the pre^test* anticipated 
post-test and actual post-test means* and the results of the 
tests of significance for actual and above anticipated gains on 
the word knowledge and comprehension subtests* and the total 
reading score of the Metrotwlitan Adiievement Test * 

As Table 9 shovs* students at all grade levels* except the 
second and fourth grades* achieved more than one year in word 
knowledge. Students in grades 3* 5* 6* 7* 8* and 9 had achievement 
levels comparable to or better than that normally expected of 
average readers in those grades. The second and fourth graders 
made actual gains of approximately eight months in word knowledge. 
The data In Table 9 show further that all of the gains in word 
knowledge were significantly above those anticipated for the 
children at each grade level based on their previous rate of 
growth. 

Table 10 shows that the actual gains in reading compre- 
hension ranged from nearly seven months for the fourth graders 
to one year and three months for the seventh graders. The 
second graders* and the fifth through the ninth graders achieved 
in reading comprehension at rates normally expected of non-reroedlal 
readers. As the t-ratios for the gains above anticipated indicate* 
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achievement in reading comprehension among children in grades 3 
through 9 >me significantly above that anticipated! Only th* 
gain above anticipated t-ratio for second graders vas not significant # 
Hovever» the second gra(^9|rs in the evaluation sample did achieve 
an average of more than one year above anticipated in reading 
comprehension » suggesting that the sample vas too small to allow 
the results to reach an acceptable level of significance • 

Table 11 shows further the success of the program in 
helping children to achieve in reading at rates above those 
expected in a regular classrocm program* It can be seen that pupils 
in the program achieved actual gains in total reading ranging 
from approximately seven months in the fourth grade to a year and 
four months in the sixth grade* Agaiiii the second and fifth 
through ninth graders averaged a year or more gain in total reading 
achievement » while the third graders averaged nine months and the 
fourth graders averaged seven months gain. As the t-ratlos for 
above anticipated gains indicate^ the achievement of children at 
all grade levels in total reading vas significantly above that 
anticipated for them based on their previous rate of growth. 

Data in Tables 9* 10 and 11 suggest that the Corrective 
Reading Program was somewhat more effective in raising the reading 
achievement levels for fifth through ninth grade students than for 
third and fourth grade students* The findings do support the 
conclusion, hovevert that the Corrective Reading Program achieved 
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tts first objective to improve participants' level of reading 
achievemek^t beyond that vhich would be expected from the regular 
classroom program. This conclusion is supported further by the 
results of analyses of pre- and post- program grade level scores 
on the comprehension subtest of the Stanford Diagnostic Reading 
Test . Table 12 shows the number and percentage of corrective 
reading students who achieved post-test scores below* the same as* 
and above expected in comprehension on the Stanford Diagnostic 
Reading Test . 

TABLE 12 

NUMBER AND PERCENTAGE OF PUPILS MAKING GAINS BELOW, 
THE SAME AS, AND ABOVE THE ANTICIPATED GRADE LEVEL SCORE 
ON THE STA^ORD DIAGNOSTIC READING TEST 



Grade 


N 


Below 


Same 


Above 


2 


5 


1 


0 


4 






(20) 


(0) 


(80) 


3 


150 


34 


10 


106 






(23) 


(6) 


(71) 


4 


142 


41 


9 


92 






(29) 


(6) 


(65) 


5 


110 


25 


12 


73 






(23) 


(11) 


(66) 


6 


23 


9 


0 


14 






(39) 


(0) 


(61) 


7 


98 


29 


6 


63 






(30) 


(6) 


(64) 


8 


166 


56 


3 


107 






(34) 


(2) 


(64) 


9 


76 


32 


0 


44 






(42) 


(0) 


(58) 


Total 


771 


228 


40 


503 


Percent 




(30) 


(5) 


(65) 
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Table 12 eh.ovs that mord than 50 percent of the children at 
each grade level obtained actual post-test scores that were higher 
than their anticipated p08t-*te8t scores. In the total corrective 
reading sample> 65 percent achieved above ext;>ected> five percent 
achieved the same as expected > and 30 percent achieved below 
expected in reading comprehension. These findings are compavable 
to those based on the comprehension subsection of the Metropolitan 
Achievement Test vhere 66 percent acihleved above anticipated i 
three percent achieved the same as anticipated and 31 percent 
achieved below anticipated in reading comprehension (see Table 8). 

Table 13 presents the means and the results of tests of 
significance for actual and above anticipated gains on the Stanford 
D la gnostic Reading Test grade level score for program participants* 
achievement in reading comprehension. It can be seen that children 
in the evaluation samples at each grade level > except the second 
and sixth grades > made gains significantly above those expected 
for them based on their previous performance. Since the second 
and sixth grade samples were substantially smaller than the samples 
at other grade levels it would be inappropriate to make any 
definitive statement about the program's effectiveness at these 
two grade levels. It should be noted that the children in the 
evaluation samples at these two grade levels also averaged gains 
in reading comprehension that were above their anticipated 
achievonent levels* but not significantly above anticipated. 
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In summary » the data In Tablo 13 further supports the 
conclusion that participants in the Corrective Reading Program» 
on the average » Improved their reading achievement levels 
aignif icantly. 

2. Level of Retardation Group Reaulta 

The Corrective Reading Program in District 24 was 
structured so that elementary school students vho ware two or 
more years retarded in reading received three periods of instruc- 
tion a week. Those vho were between one and two years retarded 
in reading were given two periods of Instxniction a week. The two 
groups were compared to determine vhlch group showed the greater 
gains in reading achievement. 

Table 14 presents the number and percentage of more 
severely and less severely retarded readers in the program who 
obtained actual post-test scores above* the same as> and below 
anticipated on the word knowledge and reading comprehension 
subtests* and the total reading score of the Metropolitan 
Achievement Test * and the grade level comprehension score on the 
Stanford Diagnostic Reading Test . 
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As Table 14 shows » more than 50 percent i and often 60 
to 70 percent of the children in the more severely and the less 
severely retarded reading; groups made gains above expected In 
the areas measured. The data do indicate* however » that a greater 
percentage of the more severely retarded readers than the less 
severely retarded readers achieved above expected in word know- 
ledge i reading comprehend ion* and total reading when measured 
by the Metropolitan Reading Test and in reading comprehension 
when measured by the Stanford Diaqnoatic Reading Test . The 
findings in Table 14 suggest that the program was more effective 
with the more seriously retarded readers than with the less 
seriously retarded readers. Thi^ is confirmed by the data in 
Table 15. 

Table 15 presents the sample sizes* means and tha results 
of testa of significance for the two groups' actual and above 
anticipated gains on the MetroTX>litan Achievement Test and the 
Stanford Diagnostic Reading Test . Although both groups achieved 
significantly above their expected levels in all areas* the 
more severely retarded readers averaged higher gains above anti- 
cipated than the less severely retarded readers. As the larger 
t-ratios for the more severely retarded group indicate* their 
gains in reading achievement were more significant than those 
of the less severely retarded group. 
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The data In Tables 14 and 15 support the conclusion that 
the program was more effective with the participants who were 
more severely retarded in reading at the beginning of the 
program than those who were less severely retarded. A similar finding 
was reported In last year's evaluation and it suggests again 
that the amount of improvement in reading achievement is directly 
related to the amount of instruction provided. 

Qyrov^h in specific Reading Skills. The second objective 
of the District 24 Corrective Reading Program was to provide 
individualized instruction so that participants vould increase 
their performance in specific reading skills. The measure used 
to evaluate this objective w»e the Stanford Diagnostic Reading 
Test . Level I of this test vas administered to participants in 
grades 2 through 4 and to some students in the higher grades whose 
previous reading achievement levels indicated this was the 
appropriate test. The Level II test was administered to children 
in grades 5 through 9. Pre-program scores on this test were 
made available to the Corrective Reading Teachers to use in 
diagnosing pupil weaknesses and planning instruction. The pre - 
and post -test means and gain scores are shown in Table 16 » for 
specified skill areas. 
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TABLB 16 

PRE- TO POST-TEST GAINS ON SUBTESTS OF THE 
STANFORp DIAGNOSTIC READINa TEST 

Pre-Test Pogt'^est 



Mean SD Mean SD 



Level I Stanford Test (Nt«39S) 



1. 


Reading Comprehension 


22.37 


9.43 


31.34 


7.67 


8.97 


26.34 


2. 


Vocabulary 


15.06 


5.39 


20.55 


7.25 


5.49 


17.77 


3. 


Auditory Disctfanin- 
ation 


26.87 


10.99 


35.56 


8.86 


8.68 


16.77 


4. 


Syllabication 


10.10 


3.55 


13.38 


4.09 


3.28 


15.48 


5. 


Beginning and 
Ending Sounds 


22.22 


6.47 


29.03 


5.10 


6.81 


25.38 


6. 


Blending 


18.54 


8.77 


26.59 


7.24 


8.05 


25.80 


7. 


Sound Discrimin- 
ation 


14.97 


6.81 


20.50 


7.70 


5,53 


18.84 



Level II Stanford Test (N»234) 



1, (a) Literal 

Compr^enslon 
<b) Inferential 

Comprehension 
(c) Total 

Comprehension 

2, Vocabulary 

3, Syllabication 

4« Sound Discrimin- 
ation 

5. Blending 

6, Rate 



16.14 


4.27 


18.91 


4.35 


2.77 


13.56 


13.66 


4.85 


16.71 


6,07 


3.05 


9.42 


29.89 


8.66 


35.42 


8.69 


5.53 


14.45 


21.95 


5.28 


24.98 


5.38 


3.03 


12.74 


14.57 


4.06 


16.12 


3.78 


1.55 


8.01 


18.86 


6.23 


21.40 


6.08 


2.54 


10.48 


21.18 


8.47 


25.56 


7.64 


4.38 


15.63 


17.87 


8.52 


19.48 


8.63 


1.61 


3.06 



♦All t-'ratios significant at .005 



ERIC 



-45- 

The t-ratios in Table IC ahow that tho pro- to post -program 
gains In each skill area were significant at tho .005 level. 
The skill areas in vhich the most significant gains were made on 
Level I of the Stanfojr^ Diao^oatic Reading Test are reading com- 
prehension* beginning and ending sounds and blending* The skill 
areas in vhich the most significant gains were made on Level II 
of the Stanford Diagnostic Reading Tost are blend ing> total 
comprehension » literal comprehension and vocabulary. The least 
significant gains were made in rate of reading on the Level II 
test and sound discrimination on the Level I test. The younger 
children in the program made gains that were generally more 
significant than those made by the older groups. 

The data presented in Table 16 support the concluriion 
that the second objective of the District 24 Corrective Reading 
Program to increase participants* performance in specific reading 
skills was achieved. Although no comparisons of gains in specific 
skills were made with groups not receiving the specialized 
instruction I controlled comparisons were made for the preceding 
objective related to total reading achievement. The inference 
can be made that the gains reported here in specific skills are 
reflective of tho total reading achievement gains and that control 
group comparisons would parallel the findings presented in the 
preceding section on reading achievement. 
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Improvement in Reading Attitude . The third objective of 
the District 24 Corrective Reading Program was to improve program 
participants* attitude toward reading. Progress tovard this goal 
vae measured by a pre- and post-program administration of the 
Reading Attitude Index (see Appendix E). The scale on this 
instrument is constructed so that a lover score reflects a more 
positive attitude tovard reading than a higher score. Therefore* 
an improvement in reading attitude vould be indicated by a de- 
crease in students' post -test scores* The pre- and post -test means i 
difference scores and the t-ratios are presented in Table 17. 

TABLE 17 

PRE- TO POST -PROGRAM CHANGES IN STATE URBAN STUDENTS' 

READING ATTITUDE* 







Pre -Index 


Post -Index 




t- 




Grade 


N 


Mean 


SD 


Mean 


SD 


Di,ff,. 


Ratio 


- P... . 


2 


5 


38.80 


8.64 


42.60 


9.45 


+3.80 


1.21 


NS 


3 


142 


42.04 


C.07 


40.92 


8.31 


-1.12 


1.42 


NS 


4 


113 


40.37 


8.66 


39.62 


9.24 


-0.75 


0.84 


NS 


5 


105 


41.48 


7.74 


40.13 


7.47 


-1.35 


1.63 


NS 


6 


23 


38.64 


7.86 


42.09 


6.91 


+3.45 


1.93 


.05 


7 


76 


41.14 


7.89 


41.01 


7.14 


-0.13 


0.16 


NS 


8 


112 


42.68 


7.85 


42.47 


9.12 


"0.21 


0.26 


NS 


9 


59 


44.83 


9.09 


45.69 


9.74 


+0.86 


0.73 


NS 


Total 


















Group 


634 


41.77 


8.46 


41.34 


8.60 


- .43 


1.23 





*A decrease in the Reading Attitude Index score represents an 
improvement In reading attitude* 

NSssNot statistically significant at ,05 



ERLC 



-47 



The t-ratios presented in Table 17 show that there were 
no significant changes in program participants* attitude toward 
reading except at the sixth grade. The direction of the change, 
it should be noted* is toward a more negative attitude toward 
reading among sixth graders* 

The data presented here Should be viewed in relation to 
the data presented earlier in Tables 10, 11 and 13. The data 
presented there show that sixth graders made the least significant 
gains in total reading and reading comprehension on t» ^.^tropolitan 
Achievement Test and that sixth graders made no significant gains 
above those anticipated for them on the Stanford Pi^aqnostic R^ad^nq 
Test . It is evident that the Corrective Reading Program was 
least effective at the sixth grade for producing change in reading 
achievement and significantly less effective at the sixth grade 
for producing improvement in attitude toward reading. 

The data presented in Table 17 support the conclusion 
that the goal of improving program participants' attitude toward 
reading was not achieved. These data indicate that sixth 
graders' attitude toward reading became significantly more negative. 

Inferences can be drawn from these results which suggest 
that the Corrective Reading Program in District 24 successfully 
teaches students how to read but it does little to hlep them 
enjoy reading. The significant gains reported for growth in 



ERIC 



.y -48- 

total reading achievement and specific skills do not result in 
a parallel improvement in students' attitude toward reading. 
The long term effects of such a corrective reading program should 
be considered in evaluating its effectiveness. Furthermore* 
the causes for not affecting students' positive attitude toward 
reading while Increasing their ability to read should be investi- 
gated. Perhaps the reasons lie in the emi^iasls on the specific 
skills taught and in the content of the materials utod. While 
reports of materials used in the program included some interesting 
literature for childrttn* the amount was minimal in relation to 
other materials used. 

Impact of Para professionals . The final objective of the 
District 24 Corrective Reading Program was to increase individuali- 
zation of instruction for program participants through the services 
of paraprofessionals as a means of increasing pupil growth in 
reading. In order to determine the impact of paraprofessional 
services* the evaluation plan called for a c<»nparison between 
students in the reiraburseable Corrective Reading Program and 
students in a parallel tax levy program that did not use the 
services of paraprofessionals, A change was made in the tax levy 
program* however* and a full time paraprofessional was assigned 
to each tax levy reading teacher in March of the school year, 
since the tax levy program included paraprofessional services 
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for only one to one and a half months before the post-teat was 
administered in April » coaipared to the seven to seven and a half 
months in the State Urban Education Program* the decision was 
made to proceed with the planned comparison. 

The comparisons between the State Urban Education Corrective 
Reading Program with seven and a half months of para professional 
service and the tax levy corrective reading program with one and 
a half months of paraprofessional service were made on the total 
reading score of the Metropolitan Achievement Test and the grade 
level score on the Stanford Diagnostic Reading Test as well as on 
attitude toward reading. The results of the analysis of covariance 
are presented in Table 18. 

TABLE 18 

COMPARISON OF STATE URBAN PROGRAM 
WITH TAX LEVY PROGRAM 



Gpoup 



N 



Pre- Post- Adj. 
Mean Mean Post 



df 



F- 
Ratio 



Total Reading 
(Metropolitan) 

State urban 390 
Tax Levy 283 

Grade Level Score 
(Stanford) 

State Urban 417 
Tax Levy 274 

Reading Attitude 

State urban 375 
Tax Levy 238 



2.61 3.54 3,66 i /c^n 
3.93 3.77 3.77 



2.28 2.97 3.07 
2.57 3.32 3.17 



41.31 40.40 40.15 
39.66 41.71 42,11 



3.73 



1/688 4.02 



1/610 9.08 



NS 



.05 



.01 
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The F-ratios shown in Table 18 reveal thati when pre-teat . 
group differences were controlled i there were no significant 
differences between the post-test scores of the State Urban 
Education students and the tax levy students in total reading 
achievement as measured by the Metropolitan Achieveraent Test* 
There were differences^ however » on the post-* test scores of the 
Stanford Diagnostic Reading Test in favor of the tax levy students* 
The results indicate that the addition of paraprofessional 
services did not significantly increase pupils* grovth in reading 
achievement . 

There was some indicationi as the data in Table 18 showi 
that students in the State Urban Education Program with more 
paraprofessional services show significantly more improvement 
in their attitudes toward reading than students in the tax levy 
program. It is difficult to conclude* however# that this change 
in attitude is directly attributable to the services provided 
by paraprofeseionals. However, it is possible that the additional 
contact provided by the paraprofessionals had a favorable effect 
on students* attitude toward the program andi therefore i their 
attitude toward reading generally^ 

In summary, the data support the conclusion that the 
addition of paraprofessional services does not significantly 
increase pupils* growth in reading achievement. The tenuous 
nature of this conclusion must be recognized, however, since 
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there was evidence that the paraprofessionals were not primarily 
involved In inatructional roles. Therefore, it would be unlikely 
that their presence would have a direct effect on pupil achievement 
as it was proixssed In the program objective. If paraprofessional 
services are proposed as a means of increasing Individualization 
of instruction in order to directly affect pupil growth in reading, 
the paraprofessional role needs to be clearly defined as instruc- 
tional in nature. When paraprofessionals do assume roles directly 
related to Instruction, then it would be appropriate to assess 
the impact of their services on pupil achievement. 
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SUMMARY AND CONCLUSIONS 

Tho summary and conclusions are arranged in an order 
corresponding to the presentation of the report. 

Qrovth in Reading Achievement . The first objective of 
the Corrective Reading Program was to improve participants* level 
of reading achievement beyond that which would be expected from 
the regular classroom program. Pre- and post-program scores on 
the Metropolitan Achievement Test and the grade level scores on 
the Stanford Diagnostic Reading Test were used to determine if 
this objective was achieved. Based on each child's previous 
rate of growth* anticipated post-^est scores were determined as a 
measure of how well the child would have achieved if he had not 
received special reading instruction. At the end of the program* 
the child's actual post-test performance was compared to his 
anticipated performance to see if the actual gains made were 
larger than those anticipated. 

The data presented in this report support the conclusion 
that the program was successful in achieving its objective. 
The following findings support that conclusion. 

1 . When actual post-test performance was compared to 
anticipated performance* more than 50 percent of the students at 
each grade level and the total group made gains above expected in 
word knowledge* reading comprehension and total reading on the 
Metropolitan Achievement Test and the comprehension subtest of the 
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Stanford DiaanoBtic Reading Tggt. In facti In total reading 
achievement I 69 percent achieved above expected i seven percent 
the eame as expected and 24 percent belov expected. 

2$ Orade level comparisons shoved that the gains made 
above those anticipated in word Knovledgei comprehension and 
total reading on the Metropolitan Achievement Test were statisti- 
cally significant for all grade levelsi except the second grade 
where students* achievement in compr^ension was greater than 
expected but not significantly greater. The same comparisons 
for scores on the Stanford Diagnostic Reading Test Indicated 
that students in all grade level S| except those in the second 
and sixth grades # made gains significantly above those expected 
in reading comprehension based on their previous rate of growth. 
The lower gains among second and sixth graders may be accounted 
for by the relatively small niunber of students in the evaluation 
samples. The second and sixth grade students in the evaluation 
sample did make average gains that were higher than expected but 
these gains were not significantly higher than expected. 

3. Comparisons of the gains of the more severely and less 
severely retarded readers revealed that more than 50 percent » 
and often 60 to 70 percent » of the students in each group made 
gains above expected in all areas of reading measured. A greater 
percentage I however # of the more severely retarded readers achieved 
above expected gains in word knowledge » comprehension and total 
reading as measured by the Metropolitan Achievement Test and 
the Stanford Diagnostic Reading Test . 
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4« Although both the more severely : nd the less severely 
retarded readers made reading achievement gains significantly 
above those anticipated for them# there was evidence the more 
serverely retarded readers made greater gains than the less 
severely retarded readers* These findings suggest that the program 
was more successful with students vho were more severely retarded 
in reading at the beginning of the program* Similar findings 
were reported in th^ 1971-72 evaluation and suggest again that 
the amount of improvement in reading is directly related to the 
amoujit of instruction provided, 

Grovth in Specific Reading Skills > The second objective 
of the District 24 Corrective Reading Program was to provide 
individualized Instruction so that participants would Increase 
their performance in specific reading skills* Pre- test and post- 
test scores on the appropriate level of the Stanford Diagnostic 
Reading Test were used to determine if this objective was achieved. 

The data presented in this report support the conclusion 
that the program was successful in increasing participants' 
performance in specific reading skills. The following finding 
supports that conclusion. 

1. When pre-test and post -test scores on the appropriate 
level of the Stanford Diagnostic Reading Test were compared t 
gains in all skill areas were significant. Younger students in 
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the procjram made qains that were generally more significant than 
gains made by older students in the program. 

Improvement in Reading Attitude . The third objective of 
the Corrective Reading Program was to improve program participants* 
attitude toward reading. Pre-program and post-program scores on 
the Reading Attitude Index were used to assess progress toward 
this objective. 

The data presented in this report support the conclusion 
that the program was not successful in improving program piirtici- 
pants* attitude toward reading. The following finding supports 
that conclusion. 

When pre-program and post-program scores on the Reading 
Attitude Index were compared i attitude toward reading was no 
more positive at the end of the program than it was at the beginning 
for students at any grade level. Students in the sixth grade 
became significantly less positive in their attitude toward 
reading during the year. 

Impact of Paraprofessionals . The final objective of the 
Corrective Reading Program was to increase individualization of 
instruction for program participants through the services of 
paraprofessionals as a means of increasing pupil growth in reading. 
Comparisons were made between the performance of students in the 
State Urban Education Corrective Reading Program and that of 
students in* the tax levy corrective reading program. 
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Tho data prosentGd in this report support tho concluf^ton 
that the addition of paraprofessional services did not slqnlfi- 
cantly increase pupils* growth in reading achievement andi there- 
fore! the program objective was not achieved. Students in the 
State Urban Education Program did show improvement in their 
attitude toward reading, however t The following findings support 
the conclusions stated above. 

1. Vfhen pre-test and post -test scores of students ^n the 
State urban Education Corrective Reading Program were compared 

to pre-test and post-test scores for students in the tax levy 
corrective reading proqtam> no significant differences were 
found in total reading achievement as measured by the Metropolitan 
Achievement Test . 

2. When pre-test and post-test scores of students in the 
State Urban Education Corrective Reading Program were compared to 
pre-test and post-test scores for students in the tax levy 
corrective reading program, significant differences were found in 
reading comprehension as measured by the Stanford Diagnostic 
Reading Tes t which favored the tax levy students. 

3. Attitude toward reading scores of the State Urban 
Education Corrective Reading Program participants on the Reading 
Attitude Index were significantly more positive than those of 
students in the tax levy corrective reading program. It is 
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dlfflcult to attribute the chftngea in attitude tovaird reading to 
the addition of paraprofeeelonal services since the role of the 
paraprofesslonal Is not clearly evident In teachers' reports of 
p&raprofesslonale^ duties* 

RKCOMMENDATIONS 

The evidence presented In this report points to the 
general success of the Corrective Reading Program In affecting 
significant student progress In basic reading skills and total 
reading achievement, Thus» the following recommendations are 
offered as guidelines for further Improving and refining the 
program now in operation. 

1. There were nearly one-third of the program participants 
who were achle\«d it less than their expected rate of growth. This 
may be due to weaknesses in diagnostic procedures and the pre- 
scriptive instruction used for these children. Every effort 
should be made to determine the causes for the low achievement of 
this group as a means of improving the reading instruction for all 
children. 

2. Since the program has been successful in improving 
basic reading skills among a large proportion of the population » 
efforts should now be made to move these students toward increased 
reading comprehension and higher level critical reading skills. 
Programmatic efforts could include increased use of a variety of 



high interest materiale and improved teaching skill for the 
development of nterpretive> inferential > analytical and 
evaluative reading skillSi The intent of such efforts would be 
not only to increase students' reading proficiency but their 
enjoyment of reading as well. There was evidence that this 
important corollary objective was not achieved in the current 
program. 

3» The district staff should seriously weigh the gains to 
be derived from inclusion of second graders in the Corrective 
Reading Program. On the basis of the selection instruments and 
criteria used in this program » it is highly inappropriate to 
include second graders. It is recommended that the program be 
limited to students in grades 3 through 9* If early identification 
of reading or other learning disabilities becomes a goal for 
District 2Ap careful study will need to be made of the concomitant 
implications for screening, selection* program and evaluation 
procedures. 

4. There was again evidence that the amount of improve- 
ment in reading achievement was relate to the amount of 
instruction received. Therefore* the staff should continue to 
accurately assign the more severely retarded readers to the 
instructional groups that meet more frequently. 

5, There was evidence that the level of professional 
preparation among the reading teachers was higher than the preceding 
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yoari This is a desirable trend and the district should make 
every effort to continue to recruit qualified specialists for 
the program. However » the number of students who are still 
not achieving above their previous rate of growth and the need 
to expand the achievement of those who aro making gains above 
expected to Include higher level reading skills do point to tho 
need for continued inservice training that emphaidzes the goals 
of this program • 

6* If the objective to provide paraprof essional services 
as a means of increasing student achievement In reading Is to be 
continued f changes must be made in the role presently assumed 
by paraprof essionals. The paraprof essionals* role should be 
defined as primarily instructional! they should receive adeguate 
training for the role^ and the reading teachers should bo adequately 
prepared to effectively use the paraprofessionals in tho instruc- 
tional program. If paraprofessionals are not used in instructional 
roles^ then this aspect of the program should be reassessed. 

7. Provision must be made for adequate time for reading 
teachers to confer with parents and classroom teachers who should 
play a significant cooperative role in the resolution of reading 
problems, 

8, The district staff should continue in the dir^ tion 
of providing adeguate diagnostic and prescriptive instrur .ion in 
the developmental reading program so that the separate Corrective 
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Headinq Procjram can be t>haeGd out. This will permit the readlnq 
specialists in each school to become reading resource teachers 
and teacher trainers who can offer classroom teachers specialized 
assistance in developing their reading programs. 
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ENOLIS}{ AS A SECOND LANOUAQB 

PROGRAM OBJECTIVES 

The primary objective of the State Urban English as a 
Second Language (CSL) Program was to increase the ability of non- 
native speaking pupils to understand and speak English. 

A corollary objective of the program was to move ESL 
students tovard the acquisition of reading and writing skills in 
English as readiness is attained. 

EVALUATION OBJECTIVES 

In order to assess program effect Ivenessi the following 
evaluation objective was usedi 

Given ratings of students* oral fluency in English on a 
pre-and post -program basis* pupils will manifest significant gains 
in their ability to use English. 

METHODS OF DATA COLLECTION 

Two measures were used to assess pupil growth In English 
as a second language. The "A to P" Scale for Rating Oral 
Language Ability of Pupils (see Appendix A) provided a measure of 
pupils' productive facility in English and is based on teacher 
ratings of cihlldren's oral skills in several language areas. 
The Linguistic Capacity Index i developed at tho Southwest Edu- 
cational Development Laboratory* was used as a measure of the 
pupils' receptive competence in English. Both tests were adminis- 
tered to students on a pre- and post-program basis. 
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Observations of the Instructional program verct tnade by 
the evaluation team using the ESL Observation Checklist (see 
Appendix B)> and interviews were held with the program coordinator! 

DESCRIPTION OF THE PROGRAM IN OPERATION 

The English as a Second Language (BSL) Program was designed 
to service children in the target population in seven schools in 
District 24. Table 1 lists the schools and the number of teachers 
in the State Urban ESL Program. 

TABLE 1 

SCHOOLS AND NUMBER OF TEACHERS 
IN THE ESL PROGRAM 

No. of Teachers 



School 


Level 


P.S. 


19 


Elementary 


P.S. 


89 


Elementary 


P.S. 


143 


Elementary 


P.S. 


199 


Elementary 


I.S. 


61 


Intermediate 


J.H. 


73 


Junior High 


a.H. 


125 


Junior High 



2 
3 



Total 

Program Design . Based on recommendations from the 
previous year's evaluationi an effort was made to design a care- 
fully planned program that was structured to provide students with 
consistent and intensive daily instruction over the entire 
treatment period. The proposed design called for 48 pupils to 
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be eervlced by each of the elementary ESL teachers and 50 to be 
serviced by each of the teachers in the intermediate and junior 
high schools. Thusf a total of 536 children were to be serviced 
by the program* 336 elementary and 200 secondary students. 

At each elementary 8C!hool> each teacher was to divide the 
48 students into three groups. Two groups of 16 pupils each vere 
to meet five times a veek in one and a half hour sessions for a 
total of seven and a half hours of instruction each veek. These 
32 pupils were to be drawn from among students In the target 
population who were rated lowest (categories "E#" and "D") 
in English proficiency based on the Scale £a£ Rating Oral Language 
Ability s£. Students . The third group of 16 pupils was to meet 
four times a week for one hour and 15-minute sessions* a total 
of five hours of instruction weekly. This group was to include 
students in categories "Fi" "D," and "E" who could not be serviced 
in the first two groups. Remaining places could be used to service 
students who were rated "C" in English oral fluency. 

At the Intermediate and junior high schools* the design 
called for each teaclier to divide the 50 pupils into five groups 
of ten students each. Each group would meet for 45 minutes per 
day* five dayts a week* a total of three hours and 45 minutes of 
instruction weekly. Three of the five groups were to be comprised 
of students most in need of instruction in English* those rated 
"F," "E**' then on the oral language scale. The remaining two 
groups were to be selected primarily from the •T)" then "C" category. 
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In schools not eligible for Title I serviceSf there were 
three 45Hninute periods set aside for providing additional 
individualized Inatruotion during the veek to small groups of 
five pupils vho vere most in need of instructiont those at the 
••F" fluency level. Teachers in these schools had tw preparation 
periods a week for program related activities such as lesson 
planning f screening f placement and orientation of new pupils f record 
keeping f administering tests f and conferences vith teachers* 
parents* guidance counselors and supervisors. In the schools 
eligible for Title I services (P.S. 19» P.S. 143* and I.S. 61)» 
the design called for five preparation periods per week in 
accordance vltli the contract vlth the United Federation of 
Teachers I hoveverf teachers could utilize these periods to pro~ 
vide additional instruction to small groups of children in the 
"F" language category. 

The program vas coordinated by the District English as a 
Second Language specialist who vas responsible for conducting 
monthly inservice training sessions and for providing ongoing 
program supervision. 

Program Implementation . Examination of class rostersf 
observations in the schools » and conferences vith the staff 
revealed that the ESL Program vas not implemented according to 
the original design described above. Scheduling difficulties* 
the number of students considered actually in need of instruction 
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voraus the number planned fox, the fluctuation In the target 
population* and administrative preferences vere factors vhich 
brought about substantial cihanges in the structure of the program 
at each school i 

In general^ the changes made at the elementary schools 
meant that eadh teacher had more instructional groups* of varying 
sizes* meeting different amounts of time daring the veek than 
originally planned. Most of the elementary teadiers taught five 
groups of children instead of three but two teachers had six 
groups and another had seven. Instructional groups varied in 
size from six to 18 children. While in bosob schools all groups 
had the same amount of instruction (e.g. 45 minutes per day* five 
days a veek) regardless of oral fluency level* in other schools 
instructional time varied according to fluency level. For example^ 
in one elementary school two groups of "F" rated children met five 
days a veek in one and a half hour sessions for a total of seven 
and a half hours of instruction weekly as called for in the design i 
however* two groups of primarily "E" rated children met only twice 
a week in 30 minute periods for a total of one hour of instruction* 
and another group of rated children met once a week for a 
total of only 30 minutee of instruction weekly. 

Similarly *changes were made at the secondary schools. 
Teachers serviced from three to five groups ranging in size 
from ten to 23 students. In general* instructional groups rated 
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lovest ("F" or "£♦♦) on the oral fluency scale received the most 
instruction* up to seven hours a veek» and those rated highest 
("D" or "C) received the least, about one and a half hours a veek. 

The modifications that vere made in the program design 
did result in a larger number of students being serviced by the 

0 

program than originally planned. However » the changes also meant 
that the average amount of time each student received instruction 
in English was diminished considerably. Clearly, the District 24 
staff must study and weigh the gains to be derived from servicing 
a lurge number of students with less instruction against the gains 
derived from providing a smaller number of students with more 
instruction. 

Another problem encountered in the program relates to the 
relatively high degree of mobility in the program population. 
As children who spoke no English were admitted to the school, it 
was necessary to transfer program participants to other ESL classes, 
if they were available, or to move students into mainstream class- 
rooms in order to provide new arrivals with needed instruction 
in English. In addition, a number of students* families moved 
and their places in the program were filled by new arrivals or 
other non-native speakers from the school population. 

To determine the extent of mobility in the program popu- 
lation, the evaluation team established 9- system whereby teachers 
were to submit a New Entrant, Exit, or Transfer Information Form 
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<6ee Appendices D and B) vhen a program participant's status 
vas changed. Data fron these records revealed that 30 to 50 per- 
cent of each teacher's original group vas exited from the program 
or transferred to other GSL groups » and replaced by new entrants. 

The transient nature of the non-English speaking populations 
in Nev York City is veil knovn and presents a difficult problem 
for those trying to design instructional programs for children 
from these populations. In District 24, instability in the 
program population further reduced the amount of instructional 
time students received. Often children had to be moved into 
mainstream classrooms before they had sufficient proficiency in 
English to successfully achieve in the regular classroom program. 

Instructional Program . In order to evaluate the quality 
of the classroom instruction* observations vere made by an ESL 
specialist on eleven ESL teachers in the program. The ESL 
Observation Checklist (see Appendix B) vas used to record ratings 
of specific instructional behaviors and the ratings of student 
behaviors. The scale used to indicate the quality of behaviors 
observed ranged from 0 to 4. Items on the scale vhich did not 
occur in the observation period vere categorized as not applicable 
(NA). On the scale* Oaunacceptable* l^barely acceptable* 
2Bacceptable» 3agood* and 4«excellent. In order to determine 
vhich instructional behaviors vere used most effectively* a rank 
order of the ratings for each behavior vas established from the 
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mftan ratings for the eleven ESL teachers. These data Indicate 
specific behaviors that were observed and the rating of the quality 
of the behaviors observed. Behaviors that vere not observed 
were tallied in the N/A cateetory. The rank order and mean ratings 
of the observed instructional behaviors appear in Table 2. 

TABLE 2 

RANK ORDER AND MEAN RATING FOR 
OBSERVED INSTRUCTIONAL BEHAVIORS 
IN ESL CLASSES 

FrequenGv Mean 

Rank Behavior N/A 0 1 2 T4 Rating 

1 Knowledge and use of student niunes 0 000011 4.00 

2 Ask guesticnt then call on student 1 0001 9 3.90 

3 Repetition after the teacher model 3 0003 5 3.63 

4 Attltude/^ianner 0 0022 7 3.45 

5 How well was "previously learned" 
material practiced* reviewed & 

reinforced? 1002263. 40 

6 Was the model appropriate for 

correct responses? 2 0032 4 3.11 

7 Speech Pattern i colloquial i 

normal classroom speed 1 0114 4 3,10 

8 How well was new material 

introduced? 4 0112 3 3.00 

8 Did teacher recognize difference 

between teaching & testing? 1 0034 3 3.00 

8 Distribution of student partici- 
pation among group. Are all 
students participating? 

8 How well was material practiced 
after introduction? 

8 How well were corrections made? 

8 How much practice with new 
materials? 



0 


0 


2 


1 


3 


5 


3.00 


5 


0 


0 


2 


2 


2 


3.00 


0 


0 


0 


3 


5 


3 


3.00 


5 


0 


1 


0 


3 


2 


3.00 
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Rank 



FreauancY Mean 
Behavior U/h 0 1 2 Rating 



,8 Hov veil vas at-home follov-up 

accomplished? 7 00121 3*00 

9 Avareness of student needs 0 1113 5 2.91 

10 Response to language cues? 4 01132 2.86 

11 Instructions and Cueing i Did 
students know vhat teacher 

expected? 0 01343 2.82 

12 Was focus of lesson clear? 0 01233 2.73 

12 How effective was individual 

practice? 0 0 14 3 3 2.73 

12 How well were audio visual aids 

employed? 0 0 3 2 15 2.73 

13 How well did teacher proceed 

from simple to c<»nplex? 4 01222 2.71 

14 Did lesson have a beginning* a 

middle^ and an end? 0 12224 2.54 

15 How well did teacher proceed 

from concrete to abstract? 7 01030 2.50 

15 How well were students' questions 

answered by the teacher? 9 00110 2.50 

16 How did teacher evaluate student 

comprehension & progress? 2 01431 2.44 

17 How well did toacher proceed 

from known to unknown? 5 01122 2.43 

18 How well did teacher proceed 

from receptive to productive? 3 01421 2.38 

19 How effective was choral practice? 0 2 1, 2 3 3 2.36 

20 How well were explanations made? 8 00210 2.33 

20 How well was drill extended into 

communication? 2 21123 2.33 

21 How effective was practice in 

speaking? 1 02431 2.30 

22 How effective was practice in 

listening 0 0 2 5 3 1 .2.27 

23 Variety of activities/change 

of pace 0 2 2 2 3 2 2.09 

24 How effective was practice in 

reading? 9 00200 2.00 
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. FyyW6t}cy Mean 
Rank Behftvlor N/A 0 12 3 4 Rating 

24 How well did teacher proceed 
from manipulation to communi- 
cation? 1 2 3 0 3 2 2.00 

25 How mucJi did the teacher talk ? 

Ratio of teacher/student talk? 0 14321 1.82 

26 Initiation of communication 

altuatlona by students? 2 14220 1.56 

27 How effective was practice in 

writing? 9 110 0 0 .50 

28 If teacher used student's native 
language* how effectively was It 

done? 11 0 0 0 0 0 

Sea let N/AtsNot applicable 2nAcceptable 
OaUnacceptable 3<*0ood 
ImBarely acceptable 4aExcellent 



It is evident in Table 2 that the two instructional 
behaviors that were used most effectively were calling students 
by name and asking questions and then calling on students. A 
teaching behavior more tuilque to ESL instruction ''repetition 
after the teacher model" wa^s the next most effectively used 
behavior. The 3.63 mean rating indicates that the eight teachers 
who used this procedure (three H/k did not use it )» used It well. 
These ratings suggest that teacher modeling and student repetition 
are -procedures that have been stressed in the background and/or 
inservice training of the ESL teachers. 

The next group of instructional behaviors that were 
rated good to excellent cover a variety of factors. The attitude/ 
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manner itemi rated 3,45, vas supported In the narrative description 
made by the evaluation team ESL specialist. The comment "Kith 
very fev exceptions »the teacihers seemed interested in their 
students and in their work. Classroom rapport and empathy 
were widely noticeabiei** parallels the high rating in Table 2. 
Reinforcement « practice and review of previously learned materials 
was demonstrated as an instructional behavior by ten of the 11 
teachers observed and was rated good to excellent by the observer 
(3.40). These instructional behaviors^ too> have obviously been 
stressed in the training provided for the ESL teachers. 

The items rated at 3.00 and above include appropriate 
modeling > rate and style of speech pattern^ introduction of new 
material* differences between teaching and testing » distribution 
of student participation* practice of new material* the manner of 
correcting students, and at-home work follow-up. These instruc- 
tional behaviors were generally observed and were considered by 
the observer to be effectively used. The frequencies listed in 
the N/A category should be noted* however* for seven of the 11 
teachers did not evidence behaviors that suggested any at-home 
follow-up of English activities that were assigned to their 
stvidents. 

Most of the other Instructional behaviors observed were 
rated acceptable (2,00) to good (3.00) and cover a variety of 
factors. Items that were rated 2.00 or lower need to be examined 
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slnco several of these behaviors aro integrally linked to the 
objectives for the program. For example* practice in reading 
(rank ordered 24th) was used by only two of the 11 ESL teachers, 
Simllariy» writing practice was used by only two of the 11 ESL 
teachers. Although acquisition of reading and writing skills 
was only a corollary objective for the prograra» it appears that 
very few teachers attempted to include reading and writing 
activities at all. This is particularly noteworthy since the 
observations were made late in the school year and it seems likely 
that some students would be ready for practice in reading and 
writing English. Teachers' use of students' native language was 
another practice totally avoided by all teachers. Theoretical 
differences about this practice still exist* yet these teachers 
all seem to accept the non-use of students' native language 
position* 

The second section of the ESL Observation Checklist 
focuses on student behaviors observed in ESL classes. The seune 
0 to 4 rating scale used to assess the quality of the teacher 
behaviors is used to assess the quality of student behaviors. 
The summary of the ratings of student behaviors observed in 11 
ESL classrooms appears in Table 3. 
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TABLE 3 

RANK ORDER AND MEAN RATXNQS FOR 
OBSERVED STUDENT BEHAVIORS 
IN BSL CLASSES 

Fyttcfuer^qv Mean 
SfiiaS P^^Yi^y N/& 0 1 2 3 4 Rating 

1 Did students seem to understand 

the teacher? 0 00128 3.64 

2 How effective was individual 
student participation in 

3 
3 

4 

4 

4 

5 
6 



repition? 


2 


0 


0 


1 


3 


5 


3.44 


What was level of student interest? 


0 


0 


1 


1 


2 


7 


3.36 


What was student attitude toward 
















materials? 


0 


0 


0 


3 


1 


7 


3.36 


Did students seem to understand 
















the material? 


0 


0 


0 


2 


4 


5 


3.27 


What was the classroom atmosphere 
















& the rapport among students? 


0 


0 


0 


3 


2 


6 


3.27 


How effective was individual 
















student response? 


0 


0 


0 


2 


4 


5 


3.27 


Did students correct each other? 

* 


8 


0 


0 


3 


0 


0 


2.00 


Did students use English outside 
















of lesson framework? 


8 


0 


2 


0 


1 


0 


1.67 


How effective was individual 
















student initiated talk? 


1 


2 


4 


3 


0 


1 


1.40 



Scale t NA"Not applicable 2«acceptable 
Osunacceptable Sagood 
l»barely acceptable 4«excellent 



The ratings seen in Table 3 indicate that all items of 
student behaviors, *»xcept three, were rated good to excellent. 
The students were judged by the ESL specialist observer to under- 
stand their teachers and the material, to participate in repetition, 
to be interested and to demonstrate a positive attitude toward 
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their classroom. The thrae items vhich vere rated low on the scale 
are related to student interaction* student initiated talk and 
use of English outside the lesson framework , These data suggest 
that the teachers are adept in teacher directed activities but 
perhaps need additional training in facilitating student inter- 
action. 

An additional factor that must be considered in interpre- 
tation of the teacher and student ratings was observed by the ESL 
specialist. The observer noted that some students attended two 
ESL classes during different periods of the clay with different 
teachers* The observer noted that students vc re being Introduced 
to the same material without relating the instruction to what had 
been introduced in the other class by another teacher. The ESL 
specialist recommended a developmental sequence of instruction 
for successive levels of language learning and observed that the 
practice of overlapping and duplication mltlg&ted against it. 

The observations also revealed that practically no work 
was being done in connection with reading comprehension and that 
no reading books of any kind were In evidence. Furthermore, 
writing was limited to copying sentences and a few fill-ln-the- 
blank exercises. Also missing from the classes was any type of 
listening comprehension oxercises. These observations suggest that 
the primary approach used in the ESL program is restricted to a 
limited use of Engltsht that is, production of the language in 
carefully structured forms. 
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Tho ESL specialist also observed that not enough of the 
teachers avail themselves of the wealth of materials available 
to them. This may be simply uneasiness vith something new* lack 
of imagination in the use of materials or insufficient training. 
The observations and the ratings combine to indicate a need to 
expand concepts about second language instruction as veil as a 
need to expand the goals of the program beyond oral language 
production. 

In order to examine more carefully the results of the 
cla88ro<»n observation data# individual teacher and student group 
behaviors were tallied. The mean ratings for eadh teacher and 
student group observed appear in Table 4, 



TABLE 4 



OVERALL PvATiriGS OF TEACHER EFFECTIVENESS 



Average Ratings 



Teacher 
No. 



Instructional 
Behaviors 



Student 
BGhaviors 



1 
2 
3 
4 



3.85 4.00 

3.81 3.75 

3.32 3.00 

3.13 3.38 



5 
6 
7 
8 
9 



2.97 3.50 

2.62 3.00 

2.59 3.10 

2.53 2.25 

2.50 3.14 



10 
11 



1 . 32 1.71 
1.48 2,50 



Scales iNf/AaNot applicable 3tsgood 

labarely acceptable 4aexceHent 
2Bacceptable 
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The ratings presented In Table 4 shov that four teachers 
vera rated good to excellent* five teachers were rated acceptable 
to goodf and tvo teachers vera rated barely acceptable to 
acceptable. These ratings strongly suggest that expanded in- 
service training of BSL teachers is warranted. 

The ESL specialist observed that ESL teachers in the 
elementary grades appeared to be more effective than Junior high 
school teachers* The evaluators avoided presentation of the 
data separated by grade level to maintain anonymity for the ESL 
teachers observed. 

EFFECTS OF PROGRAM ON CHIIDREN 

Data collected from teacher records indicated that 15 
different native languages were represented by students in the 
State Urban ESL Program. The majority of the children, 84 per- 
cent* were Spanish speaking children. District 24* s aim is to 
develop non-native speaker's language facility in English so that 
they will be able to function adequately in scihool. To this end, 
the oral-aural approach was emphasized in teaching English as a 
second language, This section of the report presents data on 
the children's growth in English language skills. 

Two measures were used to assess the extent to which 
the program objective was achieved. The results are baaed on 
data for all children in the program for whom pre- and post-program 
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ecoras v«re aval labia on both of the evaluation measures. Complete 
data were available for a total of 416 pupils. 

Pff9<IWfrAY9 ^miin\\ ^ftrKmffgft PffOjfjLqjtffl<?7. to assess 
children's growth in productive English language skills^ teacher 
ratings on the Oraj Language Ability Scale (OLAS) wore used, This 
scale is a modification of the "A-F" New York City Board of 
Education Language Rating Scale which was prepared and tested 
last year by the District ESL staff. Each child is individually 
tested and rated in five languagd areas i structural patterns* 
vocabularyi pronunciation* situation interpretation* and intonation 
(see Appendix A), in each area the child is rated on a six-point 
scale from Aa6 to FaO with "F" representing "Speaks No English." 
The ratings in each area are summed and divided by five to obtain 
the child's English oral fluency score. 

The Oral Language Ability Scale (OIAS) was used initially 
to screen children in the target population at each school. 
Children in the *'F" to category were selected for the program, 
however* pupils in the lowest categories were to receive priority. 
Teachers' pre- program ratings on the OIAS were compared to post- 
program ratings for evaluation p^arpoaes. Because no control 
group was available for comparison* a' groups by test analysis was 
done in order to derive as much information from the data collected 
as possible. The subjects were divided into three groups i the 
first groJp included children in grades kindergarten to three* 
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thd second group Included grades 4 to 6» and the third group 
Included grades 7 to 9. 

The sample slzesi pre-and post-program mean ratings » the 
mean gains and the results of the analysis of variance for each 
OlAS language area and the total OIAS oral fluency score are 
presented In Table 5. 

The mean data in Table 5 reveal a language learning 
pattern that is fairly consistent across each subsection and 
the total oral fluency score on the OIAS. . This pattern shows 
the youngest children » grades^K-to 3 » to be the least skilled 
in English and the oldest children to be thd most sldlled at the 
beginning of the program. Hoveveri the post means show that 
by the end of the program children in each of the three grade, 
groups were similar in each of the skill areas measured » suggesting 
systematic differences in language learning among the three 
groups. As the mean gain data indicate » the kindergarten to 
grade 3 group made the greatest gains in all but one area, the fourth 
to sixth grade group made the next highest gains » and the junior 
high school students in grades 7 through 9 made the lowest gains. 
TVie systematic nature of the differences in growth in English 
among the three groups is further confirmed by the results of 
the analyses of variance, 
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As Table 5 shows all F-ratios for Tests (T) are highly 
significant (p-^,001) indicating that for tho total ESL sample^ 
regardless of grade level t children in the program made signifi- 
cant pre- to post-test gains in each language skill area* 
However I as the interaction (G5tfP) F-ratios also show» the 
differences among the three grade groups were highly significant 
(p<:*001). These findings support the conclusion that, based 
on teachers* ratings of children* s English language skills, the 
ESL Program was the most successful with children in the lowest 
grades (K-3) and the least successful with children in the 
highest grades (7-9), 

The results in District 24 are not inconsistent with 
general Knowledge in the field of language learning. Language 
gains are generally greater among younger children. 

The total scores on the OLAS were used in another analysis 
which compares the number of pupils at each general oral fluency 
level at the beginning of the program with the number at each 
level at the end of the program. The findings are presented 
in Table 6. 
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TABLE 6 

COMPARISON OF NUMBER AND PERCENTAGE AT EACH 
ORAL LANGUAGE FLUENCY LEVEL AT THE 
:3E0INNING AND END OF THE PROGRAM 

Pre-test Oral Post-test Oral Fluency Level 



Fluency Level F E D C 



Ratina 


N 




N 


M 


N 


{^) 


N 




N 


{%) 


F 


157 


(38) 


7 


(4) 


52 


(33) 


93 


(59) 


5 


( 3) 


E 


111 


(27) 


0 


(0) 


10 


( 9) 


93 


(84) 


8 


( 7) 


D 


121 


(29) 


0 


(0) 


2 


( 2) 


79 


(65) 


40 


(33) 


c 


27 


( 6) 


0 


(0) 


0 


( 0) 


8 


(30) 


19 


(70) 


Total 


416 


(-100) 


7 


(2) 


64 


(15) 


273 


(66) 


72 


(17) 



As Table 6 shove t 38 percent of the evaluation sample 
were rated in oral fluency at the beginning of the program^ 
\rtiile 27 percent t 29 percent and 6 percent were rated 'D," 
and **C,** respdctivelyt by their ESL teachers. By the end of the 
program only two percent were rated "Fi** 15 percent were rated 
66 percent were rated **D" and 17 percent were rated "C." 
The data do 8how» however t a definite trend in favor of 
those children rated lowest in English at the beginning of the 
program. The pattern that evolves is one in whidh teacihere 
tend to rate more of the children rated "P" as ha%'ing moved up 
more levels in English proficiency than children in any of the 
other oral fluency levels. As Table 6 indicates t based on 
teachers* ratingst 33 percent of the children rated lowest (F) 
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initially moved one level to "E,*" 59 percent of this group moved 
two levels to and three percent moved three levels to a "C** 

rating. However^ those children with the most facility in English 
at the beginning of the program (C level), according to their own 
teachers* assessment, made no gain in their basic oral fluency 
level. In fact, 30 percent of the children rated "C** at the 
beginning of the program were rated one level lower at the end 
of the program and the remaining 70 percent were rated at the 
same "C* level* 

These findings indicate that teachers* subjective ratings 
on language measures, such as tlie CIAS, are inadequate measures 
for discriminating among finer lavels of pupil growth in English 
as a second lain^^age. It is possible that the children in the 
program who initially had the least proficiency in English were 
actually the ones who made the greatest gains, especially since 
these children generally received the most instruction. It is 
possible > however, that teachers' post-- program ratings were 
somewhat inflated since children who speak no English at all at 
the beginning of the program will likely appear to have made 
extensive gain if they speak any English at all at the end of 
the program. Consider, too, that it is unlikely that all of 
the children rated at the highest level of proficiency (C) made 
no gains in basic oral fluency in English by the end of the program. 
These children received not only special instruction in English 
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as a second language i but regular classroom instruction also* 
The more reasonable explanation relates to the basic inadequacy 
of the oral fluency scale in discriminating language growth 
among children with some reasonable facility in English. As 
indicated in last yearns report $ measures like the "A to F" 
scale "can clearly be used to identify F«rated children^ those 
who are unable to respond satisfactorily* It is less appropriate 
for discriminating among Et D or C level children, 

Receptive English I/anouage Proficiency . In order to 
obtain a more objective measure of pupil growth in English as a 
second language, arrangements were made to administer the Linguistic 
Capacity Index (LCI) on a pre- and post-program basis. This test 
was denreioped as a measure of English language readiness and has 
been u^ed to assess pupil achievement in learning English as a 
foreign language. 

The LCI is a receptive language measure consisting of 
three sections i vocabulary recognition t contrast ive phonology, 
and contrast ive grammar • A total score is derived from the sum 
of the three subsection scores « Table 7 presents the sample sizes, 
pre- and post-program means, the mean gain and the results of the 
groups by test analyses of variance for each subtest and the total 
score on the Linguistic Capacity Index # 
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The pre-test means shown in Table 7 reveal a consistent 
pattern among the groups of students in grades kindergarten through 
the third grade, fourth through sixth, and seventh through ninth. 
For vocabulary recognition, contrastive phonology, contrastive 
grammar and the total score, as measured by the LCI, the mean 
scores gradually increased on the pre-test ao the groups 
increased in grade level. The post -test means follow a similar 
pattern across grade levels, however, the gain scores reveal a 
pattern which is nearly reversed. The gain scores in Table 7 
show that the K-3 group gained more than the 4-6 group in all 
three subsections and the total score of the ICl, and that the 
4-6 group gained more than the 7-9 group on two of the subsections 
and the total score of the LCI. The exception to the pattern 
e/ident in the gain scores occurs in the contrastive phonology 
subtest. In this instance, the 7-9 group gained more than either 
the K-3 group or the 4-6 group. 

The analysis of variance results in Table 7 show that all 
F-ratios for Tests (T) are highly significant (p4»001) indicating 
that on the LCI measure, also, program participants as a whole 
made significant pre- to post-Hprogram gains in each language skill 
area. The analysis of variance results further indicate that 
the age related pattern of the gains (younger groups gained more) 
were significant. The one exception to this pattern is shown in 
the contrastive phonology subtest of the LCI. The interaction (GxT) 
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F-ratio for this subtest was not significant indicating that 
although the oldest students made greater gains than the other 
two groups f the differences among the group gains were not 
significantly different. The interaction (OxT) F-ratios for 
vocabulary recognition, contrastive grammar and total score on 
the LCI were significant. These data support the findings 
discussed from the OIAS teacher ratings. The ESL program was 
more effective at the lover grade levels than it was at the 
upper grade levels* 

While the age related nature of language learning facility 
may be the major factor to account for these results , additional 
factors should be considered. The additional factors nay include 
variation in instructional approaches and teacher effectiveness 
at the elementary and junior high schools. Observations of the 
classroom program indicated a general trend that showed instruc- 
tion to be more appropriate for children at the elementary level 
than it was at the junior high school. Further examination of 
ways to improve ESL teaching effectiveness, particularly 
at the upper grade levels, Is clearly warranted. 

SUMMARY AND CONCLUSIONS 

Examination of program records, classroom observations 
and interviews with the ESL staff revealed the following. 

1. Major changes in the planned program design were 
made at each school. These changes did result in more students 
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being serviced by the program than originally planned, but the 
changes also resulted in a concomitant reduction in the average 
amount of instruction in English received by students in the 
program* 

2* The high mobility of the non-English speaking 
student population brought some instability to the inatructional 
program and further reduced the amount of instruction students 
received. A ntmiber of students were transferred to the mainstream 
program before their language facility vae adequate for academic 
success in a regular classroom program. 

3* A wide range of ESL teacher competence vas observed* 
In general, ESL teachers vere skilled in a narrow range of 
teaching b^aviors related to second language learning. 

Analysis of pupil performance on the Oral Lanauacre Ability 
Scale and the Linguist ic Capacity Inde>c resulted in the following 
findings. 

1» For the total ESL sample, regardless of grade level, 
students in the program showed significant pre-to post-^test gains in 
all receptive and productive English language skill areas. 

2, A consistent age related pattern of language learning 
emerged from the data. Children in grades kindergarten through 
grade 3 showed the greatest growth in English proficiency, 
students in grades 4 through 6 demonstrated somewhat less growth. 
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while students in grades 7 to 9 demonstrated the least amount of 
growth in English proficiency. 

While the data did show that students in the ESL program 
made significant gains in their ability to understand and speak 
English > no conclusive statement can be made about the program's 
effectiveness since no comparison group was available. It is 
difficult to conclude^ thereforet that the gains made by the 
students in the ESL program wjere greater than those that might 
have been expected from students in a regular program with no 
specialized instruction in English. 

RECOMMENDATIONS 

Based on the findings of this evaluation of the ESL 
program^ the following recommendations are made. 

1. An effort must be made to structure the ESL program 
so that students will receive consistent and adequate amounts 
of instruction in the use of English commensurate with their 
level of language proficiency. 

2. A study should be made of the e^ctent and nature of 
the population mobility in each sdiool in order to design a 
program that would provide stable instruction for larger numbers 
of students < Provisions must be made to offer new arrivals 
needed instruction in English without transferring students to 
the mainstream before they are proficient enough in English to 
succeed academically. 
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3. There is a need to recruit teachers for the program 
who have been adequately trained in ESL techniques or to expand 
the inservice training in order to improve the present ESL 
teachers * ef f ect iveness • 

4; While oral fluency in English is essential as a 
valid objective f the ESL program should be expanded to include 
the tool subjects of reading and writing in English if students 
are to successfully achieve in the regular school curriculum • 

5. Because of the subjective nature of teacher ratings, 
it is suggested that whenever possible more objective measures # 
such as the Linguistic Capacity Index t also be used. Multiple 
measures provide more accurate information for pupil selection, 
for diagnosis of children's language strengths and weaknesses, 
and for assessment of pupil achievement in learning English 

as a second language^ 

6, Analysis of pre- and post -program scores showed that 
the youngest children in the program (grades kindergarten to 3) 
made the greatest gains. Although the greater language learning 
facility generally found among younger children may account for 
this finding, other factors such as differences in instructional 
approach, program structure and teacher effectiveness may have 
been operating. These and other factors should be examined in 
order to determine how the effectiveness of the program might 

be increased in the upper grades. 
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APPENDIX A 

CORRECTIVE READING PROGRAM - DISTRICT 24 

New York University 
The Center for Field Research and School Services 

READING TEACHER QUESTIONNAIRE 
School Date 

Reading Teacher's Name Code (leave blank) 

Funding t !• Title I 2. Optional Assign* 3. State Urban 

PLEASE NOTE t All responses will be held in strict confidence and 
will be used only for evaluation of the program. 
No person connected with the school or the Board 
of Education will have access to these data. 



SECTION A - EVALUATION OF INSERVICE TRAINING 



The following questions are aimed at an assessment of the inservice 
training provided for Corrective Reading Teachers as part of 
this year's program. We ask for your honest appraisal of this 
aspect of the program. 

1. Instructions * Listed below are topics which may have been 
covered during the afternoon staff meetings * Use the rating 
scale below to eva^ua;fce the adequacy with which each was 
covered during training sessions. IPut your rating in the 
space provided before the topic* For any item that was not 
covered, write NC. 

Scale I 5«Very Satisfactory! 4s>Above Average i 3=sAverage, 

2=!Barely Satisfactory, laUnsatisfactory, NC^Not Covered 

Rating Topi c 

(a) Organization, administration and supervision of 

the program 

(b) Objectives and rationale for the program 
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Rating 



(c 
(d 
(e 
(f 

(g 

(h 

(i 

(3 
(k 

(1 
(m 
(n 
(o 



Topic 

Criteria for selection of proqram participants 
Procedures for selection of student participants 
Specific procedures for diagnosis 
Knowledge of reading skills 
Methods of corrective instruction 
Use of instructional materials 

Teacher selection and evaluation of program material 

Organizing the class for instruction 

Techniques for evaluating pupil progress 

Record-keeping policies and procedures 

Techniques for using paraprof essionals in the program 

Techniques for parent involvement 

other (Please specify) 



2. In your opinion, was the amount of inservice training sufficient? 

1 . No 2 . Yes 

3, Please give your overall rating of the inservice training 
provided for Corrective Reading Teachers this year, 



1 Unsatisfactory 
3* Average 



2, Barely Satisfactory 



4, Above Average^ 



5. Very Satisfactory^ 



4. Did you participate in the Corrective Reading Program last 
year (1971-72)? 



1 . No 



2. Yes 
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5. If your answer to question 4 is yes, how would you evaluate 
this year's training program in comparison to last year's 
sessions? On the whole, this year's training wasi 

1. 2. . 3. ^ 

Inferior About the same Superior 

Please feel free to write additional comments about the 1 iservice 
training provided by the program and your suggestions for 
improvement . 



SECTION B - READING TEACHER EVALUATION OF PROGRAM EFFECTIVENESS 

1. Listed below are itene related to different aspects of the 
Corrective Reading Program. Use the following rating system 
to evaluate the quality and/or effectiveness of each aspect 
of the program. 

1 -Unsatisfactory, 2=Barely Satisfactory, 3=Average, 
4=Above Average, 5=:Very satisfactory, NA=Not Appropriate 

P»-n qram Organization 

Rating i£SI9 

_^ (a) Organization of the program (number of classes, 

~ scheduling, etc.) 

(b) Amount of time allocated for pupils receiving 
corrective reading instruction 

(c) Number of pupils in each group 

(d) Overall Rating for Program Organization 
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Pupll Selection 



Rating 



Need 



Item 



(a) Criteria used to select pupils for the Corrv^ctive 
Reading Program 

(b) Procedures used to select pupil participants 

(c) Assignment of pupils to instiructional groups on basis 
of severity of reading retardation 

(d) OveraJl Rating for Pupil Selection 



(a) Number of students serviced by the program compared 
to number who need corrective reading instruction 



Physical Facilities and Materials 

(a) Size of the room provided by the school 

(b) Physical facilities in the room 

(c) Adequacy of the types of instructional ( workbooks t 

literature* audio visual aids* etc.) materials in the 
program 

(d) Quantity of materials provided for the number of 

children serviced 

(e) Availability of materials at the start of the program 

(f ) Overall Rating for Facilities and Materials 



Procedures for Diagnosis and Evaluation 

(a) Use of the Informal Reading Inventory to establish 

reading levels and to evaluate growth in reading 

(b) Use of the Metropolitan Reading Test to evaluate 

growth in reading 

. (c) Use of the Stanford Diagnostic Test to assess 
individual weaknesses and strengths in reading 
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Rating Item 

(d) Adequacy of materials and instruments supplied for 

diagnosis and evaluation 

(e) Appropriateness of the record keeping systen^ 

established for the program 

(f) Overall rating for Diagnostic and Evaluative Procedures 

and materials used in the program 

S tudents 

(a) Pupils* attitude toward the corrective reading classes 

(b) Observable improvement in pupil perfojrmance 

Parental Involvement and Attitude 

(a) Extent of parent involvement in the Corrective 

Reading Program 

(b) Parent's attitude toward the program 

(c) Time to confer with parents through individual and/or 

group conferences 

Personnel Support 

(a) Cooperation of school personnel generally 

(b) Comraunication between classroom teachers and yourself 

about pupil progress 

(c) Extent to which reading materials t procedures t and 

techniques used in the Corrective Reading Program 
have been adapted by classroom teachers 

(d) Amount of time provided to confer with classroom teachers 

(e) Classroom teachers* attitudes toward Corrective 

Reading Program 

(f) Supervision and assistance provided by the reading 

coordinator 



ERLC 



-96- 



2. Did you participate in the Corrective Reading Program last 
year? 

1. No 2. Yes 



3. If your answer to question 2 is yes, what is your overall 
impression when you compare this year's program to last 
year's program? This year's Corrective Reading Program isi 

!• 2. 3, 

Inferior About the same Superior 

4» Would you be interested in participating in a similar program next 
year? 

1 . Yes ^ 2 • No 3 . Not sure 



Please feel free to vrite additional comments about the program 
and suggestions for improvement. (We would be interested especially 
in your comments about those aspects of the program you rated low 
in item 1 above. ) 



SECTION C - READING TEACHER EVALUATION OF SUPPORTIVE SERVICES 
1 • Pa raprof ess iona Is 

(a) How many paraprofessionals were assigned to your 
reading program? 

(b) Could you have used additional paraprofessionals? 
Yes No 
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(c) When did they begin vorkinof? 



(d) Did the paraprofeusionals receive any special training 
for the program? 

Yes No 



If yes^ who provided the training? 



(e) Briefly describe responsibilities assumed by the parapro* 
fes8ional(s) in your program* 



(f) Please rate the adequacy of the paraprofessionals pre«- 
paration and skills for the program 

1 2 3 4 

Inadequate Barely Satisfactory Above Average 

Satisfactory 

5 

Very Satisfactory 

(g) What is your overall rating of the services provided by 
the paraprofe^isionals? 

1 2 3 4 

Unsatisfactory Barely Average Above Average 

Satisfactory 

5 

Very Satisfactory 

(h) Indicate your suggestions for improving the contributions 
that can be made by paraprofessionals in this Corrective 
Reading Program. 
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2* Guidance Services (Optional Assignment Prcvjram) 

(a) Approximately how many of your corrective reading 

students received the services of the guidance counselor? 



(b) How would you rate the frequency of your contacts with 
the guidance counselor regarding your students? 

1 2 3 4 5 

None Rarely Occasionally Frequently Very Often 

(c) How would you rate the quality of your contacts with the 
guidance counselor? That lsi to what Jegree did his/her 
services help in leading to the resolution of students* 
problems? 

1 2 3 4 5 

Not helpful Helpful Very Helpful 

(d) What suggestions do you have for improving the guidance 
services provided for optional assignment students in 
the reading program? 



SECTION D - READING TEACHER BACKGROUND INFORMATION 
1. EDUCATIONAL BACKGROUND 

Degree Year Institution Major Field 
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2. COURSE WORK RELEVANT TO TEACHING CORRECl^IVE READING 

Check those courses which you have taken and indicate the 
institution and year* (Do not include inservice courses here.) 

Content of Course Institution Year 

Foundations of Reading Instruction 

^Diagnostic Techniques - Reading ^ 

Corrective' Reading Instruction 

Reading in the Content Areas 

^Teaching Individualized Reading 

Other 



3. TEACHING EXPERIENCE 

School Grades No* of Years Regular or Substitute 



4, EXPERIENCES SPECIFIC TO TEACHING CORRECTIVE READING 

Check those experiences which you have had nd the number of years 

Experience No. of Years 

Corrective Reading - Public Schools 

^After-school Tutorial Reading Program ^ 

Parent-volunteer Reading Tutor 

Private tutorial work in Reading 

Other 
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INSERVICE COURSES IN CORRECTIVE READING 

List the inservice courses relevant to Corrective Reading 
which you took before this academic year. 

Course Year 



PRESENT INSERVICE COURSES 

List any inservice coutSb^s related to Corrective Reading which 
you have taken this year. 

Course Instructor 
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APPBNDIX B 

CO RRECTIVE READING PROGRAM - DISTRICT 24 

New York University 
The Center for Field Rese&rch and School Services 

PRINCIPAL'S QUESTIONNAIRE 



NAME DATE 



SCHOOL^, 



PLEASE NOTE I All responses will be held in strict confidence and 
will be used only for evaluating the program and 
for making recomnendations for improvement. No 
person connected with the school or the Board of 
Education will have access to these data. 

SECTION A - EVALUATION OP INSERVICE TRAINING 

The following questions are aimed at an assessment of the inservice 

training provided for Corrective Reading Teachers as part of 

this year's program. Please answer to the best of your knowledge. 

1. In your opinion* was the amount of inservice training sufficient? 
1. No 2. Yes 3, Don't know 

2. Give your overall rating of the adequacy of the inservice 
training that was provided for Corrective Reading Teachers. 

1 . Unsatisfactory 2 . Barely satiafactory 

3. Average 4. Above Average 5. Very satisfactory 

(DK) Don't Know 

3. Did any of your teachers participate in the Reimbursable 
Corrective Reading Program last year (1971-72)? 

1 . No 2 . Yes 
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4, If your answer to question 3 is yes, how would you evaluate 
this yearns inservice training program in comparison to 
last year's. On the whole # this year's training wasi 



Inferior About the same Superior 

Please feel free to write additional comments about the inservice 
training provided for teachers in the Corrective Reading Program. 



SECTION B PRINCIPALS' EVALUATION OF PROGRAM EFFECTIVENESS 

I* Instructions ! Listed below are itews about aspects of the 

Corrective Reading Program in District 24. Use the following 
scale to evaluate the quality and/or the effectiveness of the 
reading program. 

Scales lvUnsatisfactory# 23Barely Satisfactory! 3s?Averagei 
4=Above Average » 5=Very Satisfactory 

Program Organization 

Rating Item 

(a) Organization of the program (including number of 

classes* scheduling of classeSf etc.) 

(b) Amount of time allocated to corrective reading 

instruction 

(c) Number of pupils in each reading group 

(d) Overall Rating for Program Organization 
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Pupil Selection 
Rating 



Iten) 



(a) Criteria used to select pupils for the Corrective 
Reading Program 

(b) Procedures used to select pupil participants 

(c) Assignment of pupils to instructional groups on 
the basis of severity of reading retardation 

(d) Overall Rating for this area 



Need 



(a) Number of students serviced by the program compared 
to the number vho need corrective reading instruction 



Physical Facilities and Materials 

_ (a) Size of the room(s) provided for the program 

(b) Physical facilities in the room(s) 

^ (c) Adequacy of the types of instructional materials 

(textsi vorkbooksi literaturei audio visual i etc.) 
used in the program 

(d) Quantity of materials provided for the number of 

children serviced 

(e) Availability of materials at the start of the program 

(f ) Overall Rating for this area 



Procedures for Diagnosis and Evaluation 

(a) Use of the Metropolitan Reading Test to evaluate 

growth in reading 

(b) Use of the Stanford Diagnostic Test to assess individual 

strengths and weaknesses in reading 
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Rating Item 

(c) Appropriateness of the materials and instruments 

used for diagnosis and evaluation 

(d) Appropriateness of the record keeping system established 

for the program 

(e) Overall Rating for this area 



Students 

(a) Students' attitude toward corrective reading classes 

(b) Observable improvement in pupil performance 

Parental Involvement and Attitude 

(a) Extent of parent involvement in the Corrective Reading 

Program 

(b) Parents* attitude toward the program 

(c) Time for teachers to confer with parents through 

Individual and/or group conferences 



Personnel Support 

(a) Cooperation of school personnel generally 

(b) communication between corrective reading teacher(s) 

and classroom teachers about pupil progress 

(c) Extent to which reading materials i procedures, and 

techniques used in the Corrective Reading Program 
have been adapted by classroom teachers 

(d) Amount of time available for corrective reading 

teachers to confer with classroom teachers 
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Rating Item 

(e) Classroom teachers* attitude toward the program 

^ (f) Quality of the services provided by the para professionals 

(g) Teachers' ability to use paraprofessionals effectively 

in the program 



(h) Adequacy of the corrective reading teachers* preparation 

and skills required for the program 

(i) Quality of the instruction generally provided by 

the corrective reading teachers 

( j) Ongoing supervision and guidance provided by the 

reading coordinator 

2, Did your school participate in the Corrective Reading Program 
last year (1971-72)? 

1. No • 2. Yes 

3» If your answer to question 2 is yes» how would you evaluate 
this year's program in comparison to last year's? 



Inferior About the same Superior 

4» Would you be interested in your school participating in a 
similar program next year? 

1. No 2t Yes 3* Not sure 



Please feel free to write additional comments about tht program 
and suggestions for improvement. We would be especially interested 
in ybur comments about those aspects of the program you rated low 
in item 1 above# 
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Name 



APPENDIX C 

CORRECTIVE READING PROGRAM ^ DISTRICT 24 

New York University 
The Center for Field Research and School Services 

READING COORDINATOR'S EVALUATION 
OF CORRECTIVE READING PROGRAM 

Date 



PLEASE NOTES All responses will be held in strict confidence 

and will be used only for evaluation of the program. 



SECTION A - EVAI.UATION INSERVICE TRAINING 

1. Instructions t Listed below are topics which may have been 

covered during the afternoon staff meetings. Using the scale 
belowt indicate the extent to which each topic was adequately 
covered during these sessions « 

Scale I 5=Very staisfactory# 4=Above average i 3«Average> 

2=Barely satisfactory^ l=Unsatisfactory, NCaNot covered 

Rating Topic 

(a) Organisation^ administration and supervision of 

the program 

(b) Objectives and rationale for the program 

(c) Criteria for selection of program participants 

(d) Procedures for selection of student participants 

(e) Specific procedures for diagnosis 

(f) Knowledge of reading skills 

(g) Methods of corrective instruction 

(h) Use of instructional materials 

(i) Teacher selection and evaluation of program 

materials 
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Rating Topic 

- (j) Organizing the class for inatrvction 

(k) Techniques for evaluating pupil progress 

(1) Record keeping policies and procedures 

, (itt) Techniques for using para professionals in the program 

J (n) Techniques for parent involvement 

(o) Other (Please specify) 



2, In your opinion^ was the amount of inserviee training sufficient? 
1 . No 2 • Yes 



3. Please give your overall rating of the inserviee training 
provided for Corrective Reading Teachers this year* 

1. Unsatisfactory 2* Barely satisfactory 

3. Average 4* Above average 5, Very satisfactory _ 

4. Hov would you evaluate this year's training program in 
ccmparison to last year's sessions? On the vhole» this year's 
training wast 

1 2 3 

Inferior About the same Superior 

Please feel free to write additional comments about the inserviee 
training provided by the program this year and your suggestions 
for improvement , 
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SECTION B - COORDINATOR'S EVALUATION OF PROGRAM EFFECTIVENESS 

1. Listed below are items related to aspects of the Corrective 
Reading Program ♦ Use the following rating system to evaluate 
the quality and/or effectiveness of each aspect of the program. 

Scale J IsUnsatisfactory, 2sBarely satisfactory, 3=:Average, 

4=Above average, 5=Very satisfactory, NA=:Not appropriate 

Program Orqanization 

Rating Item 

, (a) Organization of the program (number of classes, 

scheduling, etc* ) 

(b) Amount of time allocated for pupils receiving 

corrective reading instruction 

(c) Number of pupils in each group 

(d) Overall Rating for Program Organization 



Pupil Selection 

(a) Criteria used to select pupils for the Corrective 

Reading Program 

(b) Procedures used to select pupil participants 

. (c) Assignment of pupils to instructional groups on 
the basis of severity of reading retardation 

(d) Overall Rating for Pupil Selection 



Need 



(a) Number of students serviced by the program compared 
to the numl:>er who need corrective reading instruction 
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Physical Facilities and Mate - iala 



Rating 

(a 

(b 

(c 

(d 

(e 

(f 

Procedures 



(a 
(b 
(c 
(d 
(e 
(f 



Students 



(a 
(b 



Item 

Size of the room(s) provided for the program 

Physical facilities in the room(s) 

Adequacy of the types of instructional materials 
(texts, vorkbookSt literature^ audio visual aids, 
etc.) used in the program 

Quantity of materials provided for the number of 
children serviced 

Availability of materials at the start of the program 
Overall Rating for Facilities and Materials 



for Diagnosis and Evaluation 



Use of the Informal inventory to establish reading 
levels and to evaluate growth in reading 

Use of the Metropolitan Reading Test to evaluate 
growth in reading 

Use of the Stanford Diagnostic Test to assess 
individual weaknesses and strengths in reading 

Adequacy of materials and Instruments used for 
diagnosis and evaluation 

Appropriateness of the record keeping system ...^ 
established for the program 

Overall Rating for diagnostic and evaluative procedures 



Students' attitude toward the program 
Observable Improvement in pupil performance 
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Parental involvement and Attitude 



Rating 



(a 

(b 
(c 



Personnel Svipport 



Item 

Extent of parental involvement in the Corrective 
Reading Program 

Parents' attitude toward the program 

Time for teachers to confer with parents through 
individual and/or group conferences 



(a) Cooperation of school personnel generally 

(b) Communication between corrective reading teachers 
and classroom teachers about pupil progress 

(c) Extent to which ideas # reading materials i procedures # 
and techniques used in the Corrective Reading Program 
have been adapted by classroom teachers 

(d) Amount of time available for corrective reading 
teachers to confer with classroom teachers 

(e) Classroom teachers* attitude toward the program 

(f ) Quality of the services provided by the paraprofessionals 

(g) Teachers* satisfaction with the services provided by 
the paraprofessionals 

(h) Teachers* ability to use paraprofessionals effectively 
in the program 

(i) Adequacy of the corrective reading teachers* pre- 
paration and skills required for the program 

( j) Quality of the instruction generally provided by 
the corrective reading teachers 
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3. What is your overall impression when you compare this year's 
program to last year's? This year's Corrective Reading 
Program is» 



inferior About the same Superior 

Please give your general evaluation of the program, indicating 
specific strengths and weaknesses. Feel free to cowment on or 
to give reasons for your ratings in 1 and 2 above. 



ERIC 
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APPENDIX D 

CORRECTIVE READING PROGRAM ^ DISTRICT 24 

New York University 
The Center for Field Research and School Services 

QUESTIONNAIRE FOR CLASSROOM TEACHERS 
WITH STUDENTS IN THE REIMBURSABLE CORRECTIVE READING PROGRAM 



YOUR NAME DATE 



SCHOOL ] 

PLEASE NOTE < All responses will be held in strict confidence and 
will be used only for evaluation of the program. 
No person connected with the school or the Board of 
Education will have access to these data, 

1* How many children in your class(es) participate in the Title 
Optional Assignment or State Urban Corrective Reading Program 
this year? 

2. Instruct ions t Listed below are items about aspects of the 
Corrective Reading Program. Use the following rating system 
to evaluate the effectiveness of the reading programt 

Scalei lssUnsatisfactory# 2sBarely Saitisfactoryi SaSatisfactoryt 
4s:Above Average, S^Very Satisfactory, NA^Not Appropriate 

Program Organization 

Rating Item 

(a) Organization and scheduling of corrective reading 

classes 

(b) Amount of time allocated for pupils receiving 

corrective reading instruction 

^ (c) Overall Rating for this area 

Need 

. (a) Number of children serviced by the program compared 
to number who need corrective reading instruction 
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Pupil Selection ^ 

Rating Item 

(a) Criteria used to select pupils for the Corrective 
Reading Program 

(b) Procedures used to select pupils 

(c) Overall Rating for this area 



Student and Parent Attitudes 

(a) Students • attitude toward corrective reading classes 

(b) Observable improvement in students' reading per- 
formance during regular class activities 

(c) Parents* attitude toward children's participation in 

the Corrective Reading Program 



Support 

(a) Communication between corrective reading teacher(s) 

and yourself about pupil progress 

(b) Extent to which you have adapted ideas, materials, 

procedures and techniques used in the Corrective 
Reading Program 

(c) Amount of time available to confer with corrective 

reading teacher (s) 

3* Did any children in your class last year participate in the 
Corrective Reading Program (1971-72)? 

1 ♦ No 2 • Yes 

4, If your answer to 3 is yes, how would you evaluate this 

year's program in comparison to last year's? On the whole, 
this year's program ist 



Inferior About the same Superior 



er|c 



5. Would you be interested in your pupils participating in » 
similar program next year? 

1 . No 2 • Yes 3 . Not sure ^ 



Please feel free to write additional comments about the program 
and suggestions for improvement. 
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APPEl^IX E 
INDEX OF READING ATTITUDE 

School Name 



Teacher Grade Date 



Circle the number which most closely tells how you feel about 
each of the statements listed below, 

1 - almost always 

2 - often 

3 - sometimes 

4 - not often 

5 - almost never 



1. 


Reading makes me feel good, 


1 2 


3 


4 


5 


2. 


I read the newspaper. 


1 2 


3 


4 


5 


3. 


I read before I go to bed. 


1 2 


3 


4 


5 


4. 


Free reading time is the best part 
of school. 


1 2 


3 


4 


5 


5. 


I like it when the teacher reads aloud. 


1 2 


3 


4 


5 


6. 


I talk about books I have read. 


1 2 


3 


4 


5 


7. 


I am a good reader for my age. 


1 2 


3 


4 


5 


6. 


I get good grades on reading tests. 


1 2 


3 


4 


5 


9. 


I read when I can do what I want to do. 


1 2 


3 


4 


.i 


10. 


Reading is my favorite subject at school. 


1 2 


3 


4 


5 


11. 


I read magazines. 


1 2 


3 


4 


5 


12. 


I read comic books. 


1 2 


3 


4 


5 


13. 


I like to read paperbacks. 


1 2 


3 


4 


5 


14. 


I like to talk about books I have read. 


1 2 


3 


4 


5 


15, 


I like to read aloud. 


1 2 


3 


4 


5 
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APPENDIX A through E 
ENGI'ISH AS A SECOND LANGUAGE PROGRAM 



1 
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APPENDIX B 

DISTRICrr 24 
BSL OBSERVATION CHECKLIST 

Scalet NAanot applicable! Oaunacceptable* lt.bar«ly acceptable j 
2oacceptablei 3agood| 4aexcellent 



Inatructl onal Behaviora NA 0 12 3 4 

1 . Attitude>4ianner 

2. Knowledge and Use of student names 

3. Ask quest ion> then call on student 

4. Avareness of Student Needs 

5. Speech Pattern t colloqulaii nomal 

classroom speed |__ 

6. Hoir much did the teacher talk ? 

Ratio of teacher/student talk? 

7. Was focus of lesson clear? 

8. Hov well was new material introduced? 

9. How well was material practiced after 

introduction? 

10. How much practice with new material? . 

11. How well was dtill extended into 

ccnmtmication? 

12. Was the model appropriate for 

correct responses? 

13. Instructions and Cueing i Did 

students know what teacher expected? 

14. Variety of activities/cihange of pace 

15. Distribution of student participation 
among group. Are all students 
participating? I 
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Instructional Behaviors 



12 3 4 



16. How well was "previously learned** 
material practiced* revlcnred & 
reinforced? 

17. How well were corrections made? 

18. How well were students' Cfuestlons 
answered by the teacher? 

19. How well were explanations made? 

20. How well was at-home follow-up 
accomplished? 

21. How Veil were audio visual aide 
employed? 

22. Did teacher recognize difference 
between teaching & testing? 

23. Did lesson have a beginning* a 
middle and an end? 

24. How well did teacher proceed 
from known to unknown? 

25. How well did teacher proceed 
from simple to complex? 

26. How well did teacher proceed 
from receptive to productive? 

27. How well did teacher proceed 
from concrete to abstract? 

28. How well did teacher proceed 
from manipulation to ccsamuni- 
catlon? 

29. How effective was practice in 
listening? 

30. How effective was practice in 
speaking? 

31. How effective was practice In 
reading? 

32. How effective was practice in 
writing? 

33. How effective was dioral 
practice? 
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Instructional Behaviors N/A 0 12 3 4 

34. Hov effective was Individual 

practice? ^ 

35. If teacher used student's native 
language, how effectively was It 

done? 

36. Repetition after the teacher model? 

37. Response to language cues? 

38. Initiation of communication 

situations by students? . 

39. How did teacher evaluate student 

comprehension & progress? | | | 1 



Student Behaviors NA 0 12 3 4 

1« What was the classroom atmosphere 

& the rapport among students? 

2, What was level of student Interest? . 

3, What was student attitude toward 

materials? 

How effective was individual student 
participation Int 

4, repetition? 

5« response? 

6. Initiation? 

7. Did students seem to understand 

the teacher? 

8. Did students seem to under stand 

the material? ^ 

9. Did students use English outside 

of lesson framework? ^ 

10. Did students correct each other? \ 
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APPENDIX C 

DZSTRXCT 24 
ESL NEW EhfTRAMr INFORMATION FORM 
1972-1973 



Fill out this form for ©ach nev student who enters your 
provtiram and send to the ESL Coordinator along with the child's 
Scal e for Rating Oral Language Ability and hisAer Linguistic 
Capaoifcy Index Booklet . 



Child's Name 



(First) 



School 



Grade 



ESL Teacher 



(Last) 
Native Language 



Instructional Group # , 
Instruction Period(8)t' 



Day 


From 


to 


Day 


From 


to 


Day 


From , 


to 


Day 


From 


to 



Date Child Entered Program 
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APPENDIX D 

DISTRICT 24 
ESL EXIT INFORMATION FORM 

Please complete this form for each student who leaves 
your program before the end of the year. If the child has been 
in the program for at least one month, then submit the child's 
post test Scale for Rating Oral Lancruaae Ability and his/her post 
test Linguistic Capacity Index Booklet. 



Child's Name _ , 

(First) (Last) 



School . Grade ESL Teacher 



Date Child Entered Program 



Date Child Left Program 



Month Day Year 



Month Day Year 



Reason for Exit 



Send this form to the ESL Coordinator at the District 
Office. Include post test rating scale record form and 
Linguistic Capacity Index booklet if <diild was in the program 
for at least one Month. 
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APPENDIX E 

ESL TRANSFER INFORMATION FORM 
1972-1973 



Fill out this form for each student vho Is transferred 
to another ESL group or teacher and return to the ESL Coordinator. 



Child's Name 

(First) (Last) 



School Grade ESL Teacher 



Student transferred tot 

A. Nev group Instructional Period(s)i 



Day 


From 


to 


Day 




to 


Day 


From 


to 


Day 


Prom 


to 


Day 


From 


to 



B, Another teacher 
Reason for the transfer 



TUTE OF 
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